Devreal

Scale By the Bay 2023 intro video by Dipankar Mazumdar

Scale By the Bay 2023 intro video by Dipankar Mazumdar

Recording: Scale By the Bay 2023 intro video by Dipankar Mazumdar

hey everyone my name is the banker and I'm a data engineer at bukit head Premio I'm super excited to join this year's scale by the way where I'll be talking about Apache Iceberg and how it enables an open lake house architecture for large scale analytics data lake house really addresses some of the you know limitations with the data warehouse and a data Lake and so you know with a data warehouse we have great data management capabilities but with the data League we also have greater scalability and cheaper calls option so the data lake house really brings the best of the both world and in this talk we're going to understand how Apache iceberg is a table format enables that so specifically for this particular talk I'm going to focus on the architecture of Apache Iceberg how we have evolved throughout the years from the table format like Hive until like Apache Iceberg and we're going to understand what happens when we run a couple of crude queries and try to understand what happens underneath those good queries finally we'll end the talk with couple of the design benefits and understand how we can apply those things for our analytical architecture so really look forward to seeing you at this year's scale by the bay and you know take care bye