Devreal

scale.bythebay.io: Ben Edwards Interview

scale.bythebay.io: Ben Edwards Interview

Recording: scale.bythebay.io: Ben Edwards Interview

I'm Ben Edwards I currently work at Starbucks as as a consultant probably the the biggest one that we've had is we you know transition a lot of people from one platform very different platform the Microsoft on to on to Scala which is very different different ecosystem different culture I think especially because scarless that I think still trying to figure out what good Scala looks like that's pretty challenging for people to be kind of like thrust into I think what often surprised people is is you know we have great hardware we have great frameworks and it is amazing how seemingly not not particularly significant things can really can really take take an application out so one that springs to mind is we were seeing massive connection pileups huge latency problem with some of that web front-end and it just turned out that we were too aggressive in tearing down connection pools and that akka has a 500 millisecond lead time on spinning a new pool back up which if you've got you know a thousand at the multiple thousands of connections like piling in that that can become that can become a huge problem it took us a long time like far longer than you you think it should have to figure that out and that's not you know like connection pooling is not like overly aggressive tear down a connection is not something when saul says like scale you know you think i need more memory i need more cpu whatever you don't think i'll i needed to tweak this value in a config somewhere that i'd never look at I think I one of the things that has been like an interesting switch that's happened recently is that yeah it used to be that you had to protect disks at all costs from access you know like there are you almost the entire tenor of database research has been you know how do you make sure that you do the minimum distance block of data and I think I think that's really been flipped on its head by the current gen of data center class SSDs and actually that the scale problem is gonna actually it's it's been turned on its heads rather than feeding CPUs its feeding its feeding storage and I think that we'll yeah it's going to necessary a whole a whole bunch of of new ways of doing things if we want to take advantage of the hardware that we go [Music] the endeavor of programming is is is writing is writing things that can be clearly understood by people to be executed by machines that to you know to provide to provide value and functional programming allows you to decompose decompose those that you know that the big problem into into smaller problems with far greater clarity than I think any other any other paradigm that I've tried over the years favorite thing about scale by the bay honestly this my first time in San Francisco and it's it's it's just been enjoying soaking up the you know kind of the rich they were out lineage you know like this is you know this is a an area filled with tech giants and it's kind of fun to be to be around them like really fun [Music] you