Scale By The Bay 2019: Alexander Ioffe Interview
Recording: Scale By The Bay 2019: Alexander Ioffe Interview
[Music] oh my my name is Alexander Yaffe and I work at Nasdaq um I do data big data small data I'm sort of I manage the flow of the data that needs to happen throughout different different processes that exist within the organization and that's that's my job [Music] um this is my first time speaking at scale by the bay I heard about about this conference originally from my meetup group in Philly that's hosted by Brian clapper and it sounded like an awesome conference so here I am this is actually not only my first time speaking in a conference of this size but actually going to a conference of this size and it's a little bit overwhelming to take in but on the other hand the environment is just so friendly that that it's been really a great ride for me I've really I I really I'm loving it here the memes that's I think I think it's important I think it's important too to do everything tempered with a lot of humor I think that there are so many parts to a talk there are so many there are so many different important things to sort of fit together and each thing needs its own its own attention um I'm really excited about talking about what I've done with Rob in literally an hour I think that it's it's amazing how much how much interesting interesting stuff can be changed and moved within really a compressed period of time you think about how it takes days and months and years to manage all these giant libraries and all these all these humongous frameworks and that you you know in big corporations you have cost estimates about some gazillion man years that it takes to do something but just the fact that we were able to sit together and write a nice integration layer between two fairly fairly large frameworks within such a short amount of time I think is really is really a testament to how amazing and powerful collaborative development can be because again you know Nasdaq like all fortune 500 companies uses a vast amount of SQL whether it be in traditional database products or humongous big data pipelines that are that are pushing terabytes through some data warehousing product it's all about being able to have the correct abstractions on top of these things and to be able to have the correct abstractions that allow the developers to stay sane and so a lot of the a lot of the work in that I've been doing for the past two years actually has been yet another giant big data pipeline that's supposed to that's supposed to push data off to all the data that's generated off to off to a regulatory organization and all of the interesting things that happen things like this were just they were not possible even six or seven years ago the the idea that you can you could handle data of this volume and this complexity so it's really exciting about where where this is going I think Heather earlier talked about the fact that with open source we got code reuse right open source is the only model for code reuse that I've ever seen that actually has gotten the picture right because inevitably if you're in a corporate shop you have to use cases really that are the most important and sort of everything ultimately becomes tailored to those two use cases versus with open source you are just forced into thinking correctly about the abstractions that you want to make so I think that open source and frameworks like will help the entire industry immense and Nasdaq in the finance industry is certainly no exception to that it was a talk on Apache era that was really good the Zeo talk was good I'm learning new things about layers of abstraction and frameworks that I didn't know existed it's it's it's a blast [Music] I think corporations these days in terms of their software stacks are doing the right thing in terms of their integration between the components in terms of using proprietary technologies together with open-source components correctly and building out those pipelines and in the finance industry and other other industries also also as well as we do that in the finance industry as well yeah yeah I think that there's a lot of very interesting movement in the industry these days companies are doing the right thing in terms of combining proprietary stacks with open source stacks even the finance data can I just continue offering that even the even the finance industry is doing the correct thing in terms of integration with open source tax which i think is a very pleasant surprise and doing the right thing in terms of the data in terms of being able to scale up things to developers and having good development practices and so all of these pieces with the integration are really just coming together we're just having this sort of this sort of all the pieces falling in line with the DevOps kubernetes stack and the reactive stack and the messaging stack and all of that sort of all coming together at the same time and it's just it's breathtaking in terms of oh my gosh I've been waiting for all of this to happen for the past five years and suddenly a lot of it is here and so I always envision these things that's happening as like a as like a trickle kind of thing a little bit of this would happen a little bit was hot would happen but it's all really quite sudden and the movement to better practices and better ways of dealing with development overall this seems to be taking a turn for the better [Music] sure oh I don't really have anything to compare to because this is my first time at a conference of this size um I've began arriving at some smaller ones but nothing nothing this big so I don't I don't have sort of any major insights to share in terms of how to do something like this logistically because I have no idea I think that I so Alexi mentioned scaled by the Hudson Bay and doing something like that that would be awesome I would definitely come to the Hat and definitely try and submit a talk for that that would be really cool in terms of in terms of just just getting bigger conferences and bigger venues I think that a component that you could integrate into a conference like this would be a hackathon I think that would fit quite nicely into sort of maybe a fourth track something like that where where you could do where you could do PACA Thon's for particular products I think that would be a natural extension of doing this sort of stuff [Music]