scale.bythebay.io: Ryan Knight Interview
Recording: scale.bythebay.io: Ryan Knight Interview
[Music] one of the biggest questions that we're dealing with right now is the question of what is strong consistency and do you need strong consistency in your database so the biggest problem that we're dealing with is there's differing levels or different views of strong consistency and a lot of people feel like strong consistency is just a right before Reid I feel like it's really more than just - right before I read it it's about compare-and-swap it's about being able to read a value update it and then write it back out so I think this is a I think this is a really big challenge for our industry today is dealing with these strong consistencies in the database and that was her a lot was my talk was about is how he pushed the consistency back down to the database where it belongs and not in the application tier well I think scaling is you know a lot of people talk about scaling from the you know the application there I think scaling is actually more interesting problem when you talk about teams and how you scale your teams you know as people get into micro services architectures you know how do you scale your teams to deal with the you know the this large growth of micro services and how do you split your teams up between micro services so I think scaling is actually more of a human problem oftentimes than it is a technical problem and having your team so you know coordinate between you know between each other to be able to scale the organization effectively coordinate the the services that they're building I mean I think one of the biggest challenges we've been dealing with is we've been building a production application one of the things you know we built this you know a fairly solid architecture a really amazing application what we didn't build into it was a good monitoring and metric system and so we had no visibility and observability into that system and so what we found is that although the system is well built and designed we had no insight into why things failed and so we fundamentally lacked the observer ability of what was going on inside of our application I think this is a fundamental problem with micro services in general is how do you gain observability into a large you know graph of Micra services and what are the communication passing that you know what services are talking to which ones and you know how do I gain that insight and that's why one of the things we're really focusing on is sto because sto brings that observer ability into your application into your micro services and layers basically provides a layer of observer ability a class your micro services so I can see communication patterns and troubleshooting you know find problems [Music] functional programming it's been around for I mean it's now I think you were finally reaching the point where it's becoming mainstream you know for a long time the problem with functional programming is you couldn't applying people who want to do functional programming that everyone thought that it was kind of like a an outlier and it wasn't really a useful thing with the adoption by you know besides just call it you know in languages like Java people are starting to realize that functional is a core paradigm that needs people developers need to learn and use and that's really kind of help the the broader adoption of functional programming and the the powerful thing with that is that now that you have a much broader ecosystem of developers you know functional programming you have you can have you know a large team of functional programmers and you see that when everyone's on the same page everyone understands functional programming that they actually can elevate their experience and have you know be more productive as a team so I and I think that's been a very powerful change in the industry is the broader adoption of functional programming just beyond you know just like semi core languages like Scala but across the board and so I think that's really been useful so what we've seen is we now have you know very like sheeps doing functional programming they're very effective and very at solving problems because they have these more powerful tools of functional programming [Music] hey yeah there's lots of exciting things that happiness well I mean I love scale by the baby because it's bringing such a broad perspective broad number of speakers to talk about such a broad number of subjects so it's not you know I really like that they've gone beyond Scala to really scale and you know there's a lot of interesting talks and coming up you know one of the ones I'm really looking forward to is the the legend of Twitter's panel talking about storage you know and hearing about the history of Twitter and a lot of the challenges they faced I mean it's really an amazing line-up of speakers that they have coming here and it's going to be an exciting conference [Music]