scala.bythebay.io: Alexandre Archambault, Versatile Scala notebooks with Jupyter + Jupyter Scala
you so yeah so that work is about the notebook is kind more in particularly about drew pataskala which is a skerrick honor for Jupiter that tie rod so in that talk I'd like to first to quickly discuss what were the motivation the motivation for writing it then just give you a quick overview of its architecture and lastly I do demo of what you can do in particular or to do calculations or we spark with it I show you proof approval concept of a flick of using fling from it and i'll show you how how to use the clotting libraries for from it so let me so I'm contributed with two shapeless and also the few few projects around it and the other of course here which is a robbery to meld appearances that I talked about here I yesterday and I too am also jess or abduct Eska and i'm working for company called kids that TV which does not eat video adversely so the limitations for writing Jupiter scar scar ends at being a simple bridge between two to project that is first under one and repeater so you know the the notebook server from the Python community repeater with which adds a nice ecosystem like a hydrogen to use to use the Jupiter canals from Adam interact which issue which is another new new UI for Drew quita esta and so Jupiter's kind ends that being a being bridge between Jupiter and ammonites and the other end which is a new fire I guess use with it so it's a ripper it's a new report from force Cara written by your leo he who must have talked about it this morning and so it has a whole bunch of of nice features and so do koske and that bringing them into to Jupiter so for now ammonite Devon superpower to spark or this kind of things out of the box so Jupiter skala uses a fork of it that I'm going to the move right after but hopefully at some point it I mean currently the differences between the Frog of Jupiter's Cara and ammonites on that becoming the gap is narrowing so at some point hopefully it will be able to write under the the original ammonite and so n1 also of the motivation of Jupiter's Quran is being able to add support for big data from acts this back flank xterra on the fly that is Luke Tasker is really a skerrick honor but we can add support for other things until so quick overview of its architecture so yeah true so it's a bridge between Jupiter and I'm night okay yes which is basically what I told you I i I'd the mood this just after so we can add which is that we can add support for spark and even I show you through proof-of-concept freak or write a song the end just a warning before that it's quite in development that is it it under and over underwent 22 rights the last year sell it as it lacks a bit documentation and to my knowledge it has just one big user which is the company where walk where about 10 20 people to use it 20 people across several teams mostly to do Spock equations on a young and also to plotting to do analysis on our rugs a strong and the what I'm going to the moon is not pushed yet so I hope it will be initially I hope I'll be able to push it new shooters because the kudzu bit rough for now and okay so for the demo so I start with splat calculations okay so we have this small anchor star and so so basically i just i installed jupiter and then the loop descara understand machine and so this is in a book I it is not run yet so basically so I Duke the sky is at its core to Skara Connor and we can add support for our costura on the fly so the first set here adds support for first park so that you can use the yankis tell that showed you just before so here basically what we do the first time just to science is logs so you know we load a sorry for j the second one loves the Russian of slack that we want so it loads back to 0 2 and the rest when loads snobbery which is the bridge from Jupiter scale that that arose to use spark from from the cam so this is the development fashion and right after that we have a few of empaths so in parts for the from the the lib just just above we we have a few parts for Spock itself the impact above here med met put at our disposal the sequel context we see just before and then we call a few method for us to set up young so we call this method by supplying it the path to our crosser configuration which is the directory under this machine then the Zoomer method is missing for specific to mr because there are a few a few things that don't work out of the box for it so here the diversion is a diversion and right after that we initialize the sprag configuration so we set the appt name we asked for these machines and SC is the spy context we're used to so I'm going to run that the transit in the red state ok sorry I'm ok so I signs the rug here so when it starts we can confer what happens in the crust are you I to wait for our application to pop up and just to be sure that everything goes well I just check the output [Music] game at his dream okay I guess is the effect I'm going to restart it ok [Music] are we to try the same with the common line which I wanted to show after but the debt right now [Music] ok so I do ya know what happened here ok so that this one started so here we have the output of objects are it's a development reference or so and here yeah okay here we have the the application corresponding to what we have in the book and through your height let's box I'm going to do some damage equations wait ok so here we are the treaty thing and with some data basically the map you know should serve as is the closure closure here and we can check in the eye but something went on ok so this is the application we just run so you can also a lot things from a data friends so I don't have some packets logs that I just will share but you can nevertheless to do some basic equations ok which we can find a shell so in that was for stock then I saw a sponge so this is not what I'm going to do is really just a proof of concept so i spawned a small fleeing craft a local flink rest are on the machine where jukka is running I don't know a match that fling I get so but also i was there but you two Reitsma bridge between flink and do class cara that that basically does what to think repair does so okay ok it was not steady state okay so this one a bit quicker so here I just led a bridge between Jupiter skaara and flink which itself depends on fling because that's like the spark your bridge just before and then we import a shooting from the bridge and we initialize Fink by giving it the address and the port of the flick rest are which we can find the right here and then I'm is the Fink environment that you can use to make equations so we can hamper so here we're just running a local file I'm running a few things and fling keys med-surg at event so this is a local grocer it still say that these things from the Doudna look I mean it's a we see that to pass the class pass of what is none booking the specific way to think so okay so we got the result yeah then we can also plot from the Canary so does this library the side n wat you scurvy gas which is a jurors to use the vicar I debris from scar and can be used from the can are here so on the first and here i wrote the library then there are few imports for vegas to the protein library this is just some boilerplate just before or just a phone okay so it was also in the state state sorry okay so and we get a plot from Vidya here now the bigger odds are bit static so I wrote a small robbery to be able to do plots with the platy library from dinner book so i'm going to quickly show it steady state so first I'm reading rubbery i'm adding your frame BOTS this is your son bear up late and then we can plot things with Pratley so it is just a scatter plot Africans to do bar charts or estero the library address is this one so that was from the netbooks and when I think with the architecture of justice class is we can do or not the same from the CLI that is for example I can copy paste the code here so I'm going to restore that i'm going to copy paste the do not book code in an ammonite session I mean this is the modified amirite so that can run a spark and and we should get the same result that we have in the winner look because I share the spec application is Rises through the cluster I'm okay I guess I'll do the just ice pack is renting a liquor store we can mean I can answer questions jurors to tourism basically so the doctors carriers can be used fruits to us so through Jupiter and through CRI and support for the frameworks can be added on the fray and I guess so supports for other frameworks could be added like Google cloud platform scalding I haven't tried but I guess it could be done and we were to bit in development but I mean Sergio Cirio series and I company it's it's open to contributions for the city if you have questions yeah yeah so where the question was what kind of modifications had to be done to ammonites for free to run smack one of them found out the biggest is to you know ammonites when you pacify me put your code in Singleton's know when you type VAR n equals to it put that in a single tone and compile that and primary signal tone is that there are not say cellulation friendly you know you if you sell a singleton you have to enunciate the conduit fields you say rise due to reference to its type and it gets regretted that when you disarray sit on another machine gets were created and and so we do code that I mean you don't realize it and so you have to rub things in classes other than thick curtains and this brings a whole bunch of new programs to manage imparts kind of tough but this can be done I think this do the biggest change that I had to go to make prosecutors to be able to use it from Duke town so that will the time now restaurant go Gwendolyn thank you okay sexy access times of it we can how many limitations of style you know I really one really can work with like there are several implementations like five that netbooks human half so which ones do you I were from Jupiter should ask to other users I guess with a mr. grade that was I Scala which I think was the first character for Jupiter whose development was a bit stale which is one of the reason I started repeat a scar the story which is specific to spac which I think should walk but it's smooth it's an office park we can't add a framework to it and I guess for Jupiter that's it then there are all those notebooks you have spagna book which to do you Ephraim to Patera and just copy pasted you have Zeppelin which is quite now the Zeppelin i think is a reference now but it's not Jupiter it's less developer friendly it's more end users okay so thanks for your attention you