Scale by the Bay 2023: Interview with Julien Le Dem.

Recording: Scale by the Bay 2023: Interview with Julien Le Dem.

so I'm um Julian Adam I'm the Project Lead for open inage so I'm not directly using AI uh but through open lineage uh we're working on enabling better troubleshooting and understanding lineage and how these Upstream data changes um impact uh models and this kind of things through metrics you can look at the distribution of the columns in the input training set and now that affect quality metrics on a model for example over the next year I'm going to be working on uh developing open lineage more and so ensuring um that we have a common standard across the data ecosystem for understanding lineage and all related metadata data quality metrics column level lineage um ownership compliance all of this yeah yesterday I watched uh talk about uh data Centric uh machine learning and that focuses on um um identifying incorrectly labeled data in the training set to improve the quality of data and training of model I thought that was very interesting and insightful so I enjoy that talk so it's interesting right I think the there been very varied talks from deeply technical researchers talking about research project and their papers and so on uh to more insight from um industry people talking out they use AI what works what doesn't work um and so very varied topics around Science and Industry I thought that was interesting and the venue is amazing and I think that the main Amphitheater uh is really impressive