scala.bythebay.io: Greg Makowski Interview

Recording: scala.bythebay.io: Greg Makowski Interview

you my name is Greg makowsky I work for Lydia data I'm the director of data science okay well our company has an open source product called c'mon Joe that's written in Scala so our engineers write in it I'm a consultant so I take it to companies and work on providing data mining consulting projects using it actually I haven't learned scholar I'm doing more of the data mining consulting in our and other data mining languages but it'll be deployed with Scala as part of the team well our current stack is with calc omq streaming into commands ax will read right to database connectors like HBase Cassandra various others and then streaming back out to with Kafka or mq we would be part of a lambda architecture so have a real-time streaming and the top and then also supported data lake down below that would be more of a data repository batch processing layer so that's our current stack I would say is our ideal stack you would have more things built in direct integration with our and other algorithms that are more sophisticated we've got integration with Stanford NLP for natural language processing than just continuing to push on the analytic edge as well as the deployments so we're very focused on once it only wants processing so we could process your paycheck so we have a lot of big clients like Barclays banks or things where if we drop a transaction that's quite non-trivial so we have to work with clients that have very high requirements [Music] well looking forward to a lot of the Einstein IQ talks also there was a good netflix talk i was just at talking about a lot of the data flow and modeling automation types of things so I like the cross between data mining and big data data foes dsl's you