Tomás Hernando Kofman of Not Diamond, discussing about gen ai model routing.
Follow/Connect:
Tomas LinkedIn:https://www.linkedin.com/in/tomashk/
Mark Linkedin: https://www.linkedin.com/in/markmoyou/
Chapters:
00:00 Intro
01:56 Not Diamond
08:36 Router Problem
13:33 Time to Build v1
15:49 Human Categories
19:01 System Prompt
27:33 Prompt Drift
30:14 Guardrails
35:48 Model Spectrum
42:23 Caching
45:50 Training Router
54:44 Cost and Latency
01:01:22 Routing Across Agents
01:03:38 Prompt Pasting
01:09:17 Routing for Multimodal Models
01:12:08 Startup
01:21:20 Building Companies in the Gen AI Era
01:27:00 Career Optimization Function
01:29:33 Career Advice
01:32:00 Rapid Round
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
24/7 News: The Latest
The latest news in 4 minutes updated every hour, every day.