This episode explores the world of embeddings, mathematical representations that allow Large Language Models (LLMs) like ChatGPT to “think” in thousands of dimensions. While humans are limited to conceptualizing in three dimensions, LLMs operate in 2048 or more, using embeddings to encode meaning and capture semantic relationships between words.
The discussion contrasts this form of statistical pattern recognition with the richer, experience-driven reasoning of the human brain. It also introduces a new technique called ‘vec2vec,’ which enables translation between embeddings from different models. While powerful, this raises potential security concerns about reverse-engineering sensitive data from vector databases. The episode sheds light on the impressive capabilities of LLMs, while also questioning what it means for a machine to “understand.”
If you are interested in learning more then please subscribe to the podcast or head over to https://medium.com/@reefwing, where there is lots more content on AI, IoT, robotics, drones, and development. To support us in bringing you this material, you can buy me a coffee or just provide feedback. We love feedback!
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
Las Culturistas with Matt Rogers and Bowen Yang
Ding dong! Join your culture consultants, Matt Rogers and Bowen Yang, on an unforgettable journey into the beating heart of CULTURE. Alongside sizzling special guests, they GET INTO the hottest pop-culture moments of the day and the formative cultural experiences that turned them into Culturistas. Produced by the Big Money Players Network and iHeartRadio.