SBTB 2023: Graham McNicoll, Open Source Warehouse Native A/B Testing.

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference Today's modern companies leverage some of the many data pipelining tools to collect their data in their own warehouse and use this data for making data driven decisions and running BI tools. For most companies, using this data for A/B testing usually requires building custom reports. In this session I'll talk about why you should be A/B testing, some of the advantages of building your own A/B testing platform using your own data warehouse, and some of the ways it can go wrong. Then I will show you a new open source experimentation platform called GrowthBook that allows you to have a customized A/B testing system without the work. Finally I will share some best practices from top companies when running an experimentation program, and how you can leverage your existing data to make your company more successful. More details available here: https://www.scale.bythebay.io/post/graham-mcnicoll-open-source-warehouse-native-a-b-testing