scale.bythebay.io: Russell Alexander Spitzer Interview
Recording: scale.bythebay.io: Russell Alexander Spitzer Interview
[Music] I'm Russell Spitzer I'm a software engineer at data stacks I think one of the most insidious ones that I've been hitting a lot lately is dependency issues we end up programming and using a lot of commonly used libraries and we're trying to develop our own libraries and especially with Java you run into the issue where you might require a particular version of guava and someone else requires a slightly different version and all of a sudden everyone's shading their own versions of the exact same library so that can end up being particularly difficult I think our biggest issues with scale are adequately provisioning or automatically determining what provisioning should be it's it's often that we end up with the case that by the time we know that we don't have enough resources it's too late so trying to automatically decide when to scale and when not to scale is I think one of the biggest challenges that hopefully will be solved in the next few years I I think some of the biggest problems are probably ethical and legal things that are going to start coming up we've had a lot of discussions so far at the conference about the aspects and ramifications of being able to do huge amounts of aggregation on data and what that means for people who possibly don't know what's happening to their own data and what's going to happen to them because of it I I think I benefit from functional programming every day I'm a big fan especially of having strong typed reusable components in my code because it makes it really easy for me to move things around refactor things build things and I just find it a lot more easy to think about the nice thing that has a whole lot of declarative state and unmovable pieces so far the diversity of talks has been amazing it's been unlike pretty much any conference I've been to before or just about every talk has an interesting perspective on things that I didn't really think about before so I'm having a great time