Intro topic: Asymmetric Returns
News/Links:
- NanoChat by Andrej Karpathy
- Pydantic AI
- 1000th Starlink this year
- ChatGPT Apps SDK
Book of the Show
- Patrick
- The Will of the Many by James Islington
- Jason
- Interview with DHH (Founder of Ruby on Rails)
Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h
Tool of the Show
- Patrick
- Factorio
- Jason
Topic: Workflow Orchestrators
- Why
- Batch jobs (embarrassingly parallel)
- Long-running tasks (e.g. transcoding video)
- Checkpointing/resuming
- How
- Message Queues
- Containerization
- Worker Pools & Autoscaling
- History & Backfill
- Steps to run workflows:
- Containerize the workflow definition and send to the cloud
- Containerize all the individual tasks
- Submit job(s)
- Examples
- Airflow
- Legacy but dominant
- Dagster
- Great UX for python developers
- Temporal: https://temporal.io/
- The new hotness
- Ray
- Low-level but very powerful
- Kubeflow
- Designed for ML workflows, integrated dashboard
- Airflow
Popular Podcasts
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Math & Magic: Stories from the Frontiers of Marketing with Bob Pittman
How do the smartest marketers and business entrepreneurs cut through the noise? And how do they manage to do it again and again? It's a combination of math—the strategy and analytics—and magic, the creative spark. Join iHeartMedia Chairman and CEO Bob Pittman as he analyzes the Math and Magic of marketing—sitting down with today's most gifted disruptors and compelling storytellers.