Exploring Velocity vs. Quality in Experimentation ft. Emma Travis

We back out here with the amazing Emma Travis to dig into 'quality vs. quantity' when it comes to experimentation programs. The conversation Ben Labay keeps trying to force, but a bit more nuance to it.

There is a time and place for quality. But there is a time and place for velocity and scaling your program up in terms of number of tests run. How do you know when to do it? And what are triggers to get you .... ahem.... From A to B.

Emma "Biscuits and Gravy" Travis joined me on this episode to go DEEP into this topic.

Emma was sick and still trooped through this episode - give her all the flowers!!!

We got into:

- When to focus on velocity vs. when to focus on ‘quality’ of experiment

- Tips on auditing your program to know if you’re too focused on quality vs. quantity

- Smart ways to focus on research when resources are limited

Timestamps:

00:00 Episode Start

3:57 Is Velocity Appropriate In Tracking Metric For Experimentation Maturity?

9:23  Velocity Increase Doesn't Always Mean A Decline In Quality

11:51  Experimentation Velocity Is Like Flying A Plane

19:19 When To Scale Velocity Vs. When To Focus On Quality

24:33 Run A Heuristic Audit Of Your Cro Program (*Bonus Points For Doing It In Miro)

28:00 What Defines "Quality" In A Test?

36:35 How Do You Communicate A Decline In Velocity Knowing You're Increasing Quality?

40:35 Good Ways To Use Ai To Help You Speed Up Research

Go follow Emma Travis on LinkedIn: https://www.linkedin.com/in/emma-travis/

Also go follow Shiva Manjunath on LinkedIn: ⁠https://www.linkedin.com/in/shiva-manjunath/⁠

Subscribe to our newsletter for more memes, clips, and awesome content!

https://fromatob.beehiiv.com/