Scale By The Bay 2018: Nimbus Goehausen Interview
Recording: Scale By The Bay 2018: Nimbus Goehausen Interview
hi I'm a Nimbus cohousing I'm principal data engineer at demand base and I live in Oakland California um well I'm responsible for a growing number of things i generally build data pipelines the my main responsibility has been a data set of companies that exist in the world and where we track them by their websites and I'm also responsible for kind of building kind of targeting audiences of those companies for for for customers who are trying to sell b2b I'd say probably dated pipelines that's that's I guess typically my bread and butter but I mean I think I think all of them are important and I like to kind of branch out and see what's what's going on and you know the new things well actually yeah my talk is mostly about best practices I'm you know it's kind of going at a broad view of data pipelines and you know considering like what are the goals you want to have as far as like you know what is production izing what is production quality mean and so you know going up you know kind of going over concepts like idempotency which you know kind of is often kind of AI abstract but connecting it to like what it really means when you're when you're kind of delivering results to others and you know touching on lambda architecture and you know the mutability of your input data and various topics like that and how they're going to impact what you're doing I'm definitely curious on the more functional tracks like how how people are trying to you know specifying things to succinctly like using using the type system to enforce more safety beyond what you might do you know kind of fight yeah with you know kind of beyond just the basic stuff of what you might do with more of the advanced features of the type system to to enforce safety well it definitely has made a big impact on my own career I started using Scala mostly because of spark and once I started doing that I started seeing the potential for functional programming paradigms for you know all sorts of reasons and and now I'm you know I'm I've you know move beyond spark in some ways still use it a lot but I can see like there's the use of these paradigms are very important for kind of maintaining building safe code and just you know getting things working without a lot of without as much headache and I'm excited about you know you know the going further with that well I really want to talk to the Unison computing guy I just heard about that yesterday and I'm very excited I you know I did you know or dare ski it's always great to hear from him I'm you know kind of John D goes I'm kind of curious to see what he he's he's talking about yeah [Music]