Devreal

Why you should attend Scale By the Bay 2017

Why you should attend Scale By the Bay 2017

Recording: Why you should attend Scale By the Bay 2017

[Music] hi I'm Jason Schwartz I'm one of the co-organizers of SF Scala and the author of learning Scala I have a special guest with me today Alexei craw brav Alexei you were known for AI by the bay for scala by the bay for SF scala what's this new conference scale by the bay so skilled by the bay is a natural evolution of scala by the bay which i had the privilege to work with you from 2014 all right and which is basically evolving into I would say much more than skull skull is one of the cornerstones of it but we always had more than scalable head data pipelines we had operations we had functional programming in in general so we're basically a slowly transition to scale through scala ii last year which was not a plural of skull about a rather skull applause scale and now basically all scale but we still have skull as one of the hearts and pillars of the new conference it's fantastic what can previous attendees to Scala by the bay find that's new at scale by the bay so I think we kind of formalized the three key tracks which people who do Scala work on and I think they're applicable beyond scholar so with a functional programming who have reactive micro services and with have fast data and all of this tracks apply much to much more than scale for instance Haskell is one of the languages Scala people also like in Renard Jennison the author of the function programs color book is now actually speaking about Haskell which is using attacked so I think he's one of the examples of kind of generalization and I like to think of functional programming in Scala now as thoughtful software engineering right so if you can do something properly I think that's a better characterization of you rather than skulls or engineer I think you're a thoughtful software engineer and you can take Costco you can you know drop down to Java if life forces you to write but that's how I think we're always thought of our speakers of our attendees as thoughtful software engineer so can take anything life throws at them take a step back think why are they are they doing this how should they do it properly and then apply this to programming and obviously in microservices you can do it multiple ways the whole idea that you can be polyglot you can compose different things and that whole area thing now is becoming more mature there are best practices there are things like linker G which is commercial finagle there is envoy which is a proxy from lift and we have a workshop on that right so and the the workshop was not to give of Google on East EO envoy ERP see the day before the conference and that's generally you know it's it's a system architecture question right so which transcends programming languages so so I would say we we have scale in spades and have to super with that's fantastic it sounds like this conference is going to have a much greater audience than Scala by the bay do you have more sponsors to match I'm really honored and surprised reported to have triple number sponsors from from last year and we have sponsors come in at a very high level partner level sponsorships from Apple and IBM Twitter is our host a returning host this year so they provide us wonderful venue their Twitter our next building where we'll have three main tracks and the fourth unconference track and multiple areas for folks to to meet so the hallway track is usually at least fourth or third of all the people and we have ample room for that so the you know we have a bicycle three top-level sponsor six platinum sponsors including interval we're recording this right now for this SS column it up we'll have nine goalsponsors and I'll have six silver sponsors and one of them stripe is actually diversity sponsor so they actually use that sponsorship to send some women a technology to our conference who would otherwise not be sent by the companies so I'm you know very honored by the fact that existing sponsors returned at double level new sports sponsors came in at very high levels all of them are sending engineers I must emphasize that 70% of sponsorship is actually passes for the engineers so companies are sending dozens of Engineers EPEL alone I believe since about 30 40 engineers so we are very happy to have our sponsors who partner with us on multiple levels including learning experience with engineers it's fantastic that's so many sponsors and apples huge that's really surprising that they're really getting involved with your conference this time I understand Elena Adel sin' a huge figure in the scala community will be one of your keynote speakers at the conference not only that she actually opens the conference so she came last year and joined the panel and she was instrumental in connecting Nepal to us and she quino's the conference it's it's very interesting to me because I knew about Apple work in the space I knew that it acquired companies where some four speakers work I know that Apple Maps is based on scholars so I kind of know a lot of different things but again I think we'll have to see and hear Hellena to talk more about this and now the Apple has pretty strong kind of guidelines about what they can and cannot talk about but the topic of her keynote it's about uncertainty and complexity in in distributed systems and if I understand correctly that's about about using scientific methods to manage distributed systems themselves which I think Apple needs at at that scale I you know I think as the rest of us I'll have to wait for the opening and see the details but I'm very excited to have Apple open and Kunal the conference that's gonna be a great opening keynote talk there now I understand a lot of people get into Scala because they work with Apache spark and you have one of the core pachi spark contributors at the caucus also speaking at the conference that is correct so Marty is a career he's a regular I think he was there at school about the Boy Wonder was first round under that name and it was he was there 2015 when we had Big Data Scala who fall the smack stack letters represented by the founders or a crater so meteii is the creator of apache spark after the privilege of hosting him at the very first spark meetup which was one office of school in 2012 and and Mattei is now professors at Stanford he's the chief technologist of data bricks he has a new project called wealth which takes abstraction of big data operations deeper and drops it down into the system level and so he calls now in rust where he provides a set of primitives as I understand that multiple data pipelines can use so he but in this sake he talks about both he talks about Apache spark and weld Disney project and he talks about composability which is a crucial point function programming and I think you know being in the P world we know the value of compressibility but I think for the general audience it will be extremely insightful to to learn what composability means for data services for all of us to catch up with Ma Tei is a privilege so I'm very happy to report that we have in fact whether the content of this keynote yesterday so it's fresher the process maleic in all secondly I can't wait to find out what he's going to talk about and his new breast based technology framework I do hear that a lot of people have been using Apache flink Netflix and other places this is another hot big data framework and you have Stephanie and speaking about that that is correct so so I again I had the honor of course in the very first Apache flink presentation in San Francisco in 2015 with all the four co-founders of data artisans the company behind blink and Stephan was actually doing that talk and so I am very interested in the progress they've made and all the companies like is alarmed are using flank it's a streaming first sequence and so I'm really looking forward to took a chap with flink see how that option was like what are the best practices and how they stack up against other streaming frameworks and it's I think the very first time we'll have a fling co-founder keynote so I'm looking forward to that and that's fantastic I can't wait to see that this is a really huge lineup one thing I'd like to know is what kind of panels do you have this year so traditionally we start an end in the community setting right we're all about convinced you saw the keynote there's a single track where when we dispersed through the three tracks and then in the evening would gather together for the panels this year would have a panel every evening and as opposed to last year when I'm addressed all the panels I think I now kind of reached my level of incompetence for some of the panels and I invited top folks in the space to moderate them so the first panel is about real-world architectures legends of Twitter and beyond so we have several principles for Twitter who went into the world and followed companies based on what they've done a Twitter such as Ivan Weaver who had a data systems and now is the founder of fonna DB William Morgan who worked with the two Tarka textures and finagle and now is the CEO of buoyant the company behind linkage the commercial open source and third-party third-party version of finagle mark McBride who founded turbine labs which simplifies deployment and continuous delivery and essentially we recover what these folks learn from Twitter and what they kind of taken to the world and what key business insides to have whether they can add value to the customers and Helena will be also on this panel so called legends of Twitter and beyond so that's the first well the second panel is functional programming for machine learning and again I think we're in a minority on that one in the sea of Python we uphold functional programming for machine learning but companies like stripe have huge successes with this tucked is also on this panel Salesforce Einstein is implementing spark in Scala and Vitali Gordon director of engineering in data science as well Salesforce Einstein will moderate this panel and the third panel is called the follow function programming and we have some of the great figures in our community talk about what makes functional programming fun and what makes us tick why you know a lot of folks in our community live longer and happier lives programming better programming languages I think the end of the day that was really matters right so I think and equal and build winners are actually gonna be on this panel dick is gonna moderate it and Bill is gonna be on the panel it will some of our beloved figures in the community so that's that was a very good way to have the conference on also early that's a fantastic waited in the conference Aleksey thanks for coming on this sounds like it's going to be an amazing conference this year Jason thanks for for speaking with me and I'm hoping all of you guys will come and join us and if you need to learn some Scala I think you can find a very good book very in Scala which you know Jason trolls for O'Reilly so we look forward to see seeing all of you at Google on November 15th and at Twitter on November 16th to 18th you [Music]