DBTB INT Andrew Or r
Recording: DBTB INT Andrew Or r
my name is Andrew and I'm a software engineer at a company called data bricks yeah so I think right now 2016 is a very exciting year for for data in particular this is because apache spark which has recently kind of entered the spotlight of big data is becoming more popular and is getting a lot of traction both in terms of users and developers over time I think there have been many new use cases that can be expressed on top of systems like spark or previously you know hadoop mapreduce including for example machine learning and sequel real-time analysis etc so I think the most exciting thing about speaking at data data by the bay today for me personally is a spark is becoming more well-known and being able to present about the details of spark in hell how most of the complexities of spark are abstracted away from the data scientist such that they don't have to worry about nitty gritty things and instead focus on finding answers I think that is very exciting so simply because simply because there are so many different use cases of data these days for example Internet of Things we can collect you know real-time data on how the pollution is doing or like how your equipments are about to fail and I think the ability to use data to to prevent down times and stuff like that that's very important to a lot of people I hope that as a result of my talk they'll learn to appreciate how a system like spark is very easy to use on the outside but there are actually many challenges involved in making it both fast and user friendly