DBTB INT Shinji Kim

my name is Shinji kim i'm a co-founder of concord systems we work on concorde which is a distributed stream processing framework it's written in c++ and built on apache missiles i would say the most exciting thing about being here at data by the bay is the opportunity to meet other colleagues and folks that are working and also building really cool systems in the data processing part i think there are a lot of new projects that i wasn't aware of that i found out from the conference and also other people that are using different types of systems and learning how they use it and talking about the best practices what works well what's not I think those conversations and networking has been the most interesting part for me I think the exciting part about paid up these days is that a lot of companies are looking to do more real-time processing a lot more companies are looking to react to their data faster rather than just having them sit on to the database and having an analyst take a look afterwards more automation and iteration of what they can do with the data I think really can impact a lot of different industries not just finance and advertising where they have always done but also in transportation or like like like airline industry stuff like that yeah I want the audience of my talked to learn more about concord we are a small company we are not necessarily really big or known in the market but we are special in a way that we are very high performance and also very flexible to deploy build time applications not just to run like etl jumps but for you to run let's say algorithmic trading applications or real-time bidding applications or alerting applications that requires a lot of support to run multiple services in real time that is something that we provide really well that we haven't found from other frameworks so the that's what I I wanted out my hardest to really understand and be interested first I think being or becoming a data scientist or data engineer can be done by playing around with data there are a lot of grades that are the public data that is out there for anyone to take a look and look at look around and change it or visualize it or gain different insights out of it being able to try different open source solutions out there because there were just so many different solutions I think it will give them a great experience for them to become a real data engineer or data scientist I think one of the ways for someone to become really good at it is by sharing their work and getting feedback from other people that have more experience from and I think the data community or people that are working in the data processing industry are mostly fairly open to give advice and feedback for someone to actually become better and I think that's what I would recommend for anyone that wants to get into data channel you