OK, we are not experts nor PhDs so most of this is probably not technically correct, but the math is so complicated and the concepts so complicated, that we thought it would be good to just get some intuition on what is happening. So this is a quick talk that summarizes readings from so many different sources about the history of AI from the 1950s all the way to January 2024 or so. It is really hard to keep up but much harder without some intuition about what is happening. We cover expert systems, the emergence of neural networks, Convolution Neural Networks, and Recurrent Neural Networks. The Attention is All You Need paper led to Transformers and then finally some intuition on how such a simple idea, that is training on things can lead to emergent and unexpected behaviors, and finally, some intuition on how Generative images work.
You can go to YouTube to see the slides we are using at YouTube and more information at Tongfamily.com
Chapters:
- 23:25 Attention is all you need Transformers
- 27:36 But it's too Simple! Emergence is surprising
- 33:04 What emerges inside a Transformer?
- 43:01 One Model to Rule Them All
- 47:54 Works for Image generation too
Popular Podcasts
Joy 101 with Hoda Kotb
Joy is essential. And it's also elusive. You can't order it, borrow it, or simply hope it into life. But now, there's a new and exciting way to start your journey toward a more joyful existence: The Joy 101 Podcast with Hoda! Best known for her Emmy-winning work and co-anchoring Today, Hoda Kotb infuses her authenticity, curiosity, and warmth into conversations with the world’s most fascinating people. Entertainment legends, sport icons, wellness experts, and everyday folks will share how they find, allow, and experience joy. Hoda will offer her own tips and takes on seeking a more balanced, harmonious life. If you're craving inspiration, support, and useful tools to maximize your joy, tune in to these candid, uplifting, and moving on-air chats. Joy after a breakup, joy as an empty-nester, joy after loss, joy as a caretaker — Hoda's new podcast will speak to you. Joy 101 with Hoda Kotb, an iHeartPodcast.
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com