This episode kicks off our first subseries, which will consist of recordings taken during my team's meetings for the AlignmentJams Evals Hackathon in November of 2023. Our team won first place, so you'll be listening to the process which, at the end of the day, turned out to be pretty good.
Check out Apart Research, the group that runs the AlignmentJamz Hackathons.
Links to all articles/papers which are mentioned throughout the episode can be found below, in order of their appearance.
- Generalization Analogies: A Testbed for Generalizing AI Oversight to Hard-To-Measure Domains
- Discovering Language Model Behaviors with Model-Written Evaluations
- OpenAI Evals GitHub
- METR (previously ARC Evals)
- Goodharting on Wikipedia
- From Instructions to Intrinsic Human Values, a Survey of Alignment Goals for Big Models
- Fine Tuning Aligned Language Models Compromises Safety Even When Users Do Not Intend
- Shadow Alignment: The Ease of Subverting Safely Aligned Language Models
- Will Releasing the Weights of Future Large Language Models Grant Widespread Access to Pandemic Agents?
- Building Less Flawed Metrics, Understanding and Creating Better Measurement and Incentive Systems
- eLeutherAI's Model Evaluation Harness
- Evalugator Library
Popular Podcasts
Las Culturistas with Matt Rogers and Bowen Yang
Ding dong! Join your culture consultants, Matt Rogers and Bowen Yang, on an unforgettable journey into the beating heart of CULTURE. Alongside sizzling special guests, they GET INTO the hottest pop-culture moments of the day and the formative cultural experiences that turned them into Culturistas. Produced by the Big Money Players Network and iHeartRadio.
The Joe Rogan Experience
The official podcast of comedian Joe Rogan.
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.