#87 A/B testing controversies and generative AI (with Shaun McGirr @ Dataiku)

Daniel Perry-Reed•22 September 2023•53 min listen

In this week's episode of The Measure Pod, we dive into a fascinating conversation with Shaun McGirr, a data expert at Dataiku and former Crap Talks presenter. We explore the world of A/B testing, experimentation, and the future of analysts' roles as generative AI becomes more prevalent. Shaun shares his thoughts on the controversy surrounding A/B testing and the importance of considering other methods of learning about the world. We discuss the challenges and potential of using generative AI in the data analytics space, and how it can revolutionize the way we work with data. Grab your headphones and stap in for an insightful and thought-provoking discussion on the evolving landscape of data science and experimentation!

Show note links:

Follow Measurelab on LinkedIn and on Twitter/X, and join the CRAP Talks Slack community.

Find out when the next CRAP Talks event is happening on LinkedIn.

Music composed by Confidential - check out their lo-fi beats on Spotify.

Master Google Analytics 4 with Daniel Perry-Reed on the next GA4 Immersion 6-week cohort training course. Early bird, charity and group discounts availible!

Quotes of the Episode:

  1. "We very commonly hear, oh, I can't do anything interesting with data or AI or predicting anything until I've got all my data perfect. It's a myth subscribed to by people who have never actually worked with data. Because if you have, you know it's never perfect and you still have to make a decision happen." - Shaun
  2. "What if you provided an interface that helped people ask the right questions or at least better questions? And if they had no questions, they could be suggested questions and they could pick the questions that they liked the most, and then the job of data people to make LLMs useful is to do prompt engineering, right? To take the small human questions right? Put more context around them." - Shaun
  3. "It still requires human curiosity." - Shaun

Let us know what you think and fill out the Feedback Form, or email podcast@measurelab.co.uk to drop Dan, Dara and Bhav a message directly.

Suggested content