Data does not just magically spring into existence. Someone, somewhere, has to decide what data gets created and the rules for its creation. We would claim that this often starts as a pretty simple exercise, and then, over time, that simplicity balloons to be pretty complex! What if, for instance, you decided to listen to every #1 song on the Billboard Hot 100 going back to its inception in 1958? You may start by just capturing the song name, the artist, and the week(s) it was the #1 song. But, before you know it, you may find that you're adding in artist details…and songwriter details…and producer details…and genre details…and instrumentation details, and your dataset has 105 columns! But, oh, the questions that dataset could answer! And that's exactly the dataset that our guest for this episode, Chris Dalla Riva, created. He uses it (with a range of supplemental datasets) for his pieces in his Substack, Can't Get Much Higher, as well as the underlying raw material for his upcoming book, Uncharted Territory: What Numbers Tell Us about the Biggest Hit Songs and Ourselves. While the underlying material was music, the parallels to more staid business data were many when it comes to the underlying processes and challenges for doing that work!
This episode's Measurement Bite from show sponsor Recast is an explanation of the miracle of randomization when it comes to addressing unobserved confounders from Michael Kaminsky!
For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Las Culturistas with Matt Rogers and Bowen Yang
Ding dong! Join your culture consultants, Matt Rogers and Bowen Yang, on an unforgettable journey into the beating heart of CULTURE. Alongside sizzling special guests, they GET INTO the hottest pop-culture moments of the day and the formative cultural experiences that turned them into Culturistas. Produced by the Big Money Players Network and iHeartRadio.
Crime Junkie
Does hearing about a true crime case always leave you scouring the internet for the truth behind the story? Dive into your next mystery with Crime Junkie. Every Monday, join your host Ashley Flowers as she unravels all the details of infamous and underreported true crime cases with her best friend Brit Prawat. From cold cases to missing persons and heroes in our community who seek justice, Crime Junkie is your destination for theories and stories you won’t hear anywhere else. Whether you're a seasoned true crime enthusiast or new to the genre, you'll find yourself on the edge of your seat awaiting a new episode every Monday. If you can never get enough true crime... Congratulations, you’ve found your people. Follow to join a community of Crime Junkies! Crime Junkie is presented by audiochuck Media Company.