scale.bythebay.io: Artem Aliev Interview
Recording: scale.bythebay.io: Artem Aliev Interview
my name our family fine work for the data stacks company I'm a software developer and I focus on data stacks analytics and graph analytics company and of the destruction surprised database well actually that probably the main problem I met is an integration of different open-source technology and well that's all and I can deep go deep into this into this detail but that's probably all and as explain especially so the main problem I admit probably when you try to integrate these different car dupe distributions because they all slightly different this the problem with the scale is a for example in spark because it's my part of the responsibility every time you try to the kind of giants with a big data sources they will get the shuffle his story and you will so and that car because on a bigger asset you always need to define two now before you run the query how much partition you need to have and that probably well strange problem of the spark [Music] everything will be digitized and we have a lot of salt I think that the main problems will be in Internet of Things area because we just have too much they will have too much data and right now it's solved just by aggregation the data and saving on aggregate but especially machine learning guys want to get source of the data all the data they have and I think this machine learning please Internet of plus Internet of Things will call this blood of the date of the map of the net number of queries l'm data's data entities and that will be a main problem well as a spark developer I like functional programming very much because it's really impressive language it allows you to define a complex query and complex algorithms in really short an expressive way well I like that there are it's not focused on one thing but there are different people that talk about different things and well especially when you talk with attending D that the really interesting thing in the real world not just a programmer for the who could unlock orange