In this episode of the Macro AI Podcast, Gary and Scott break down NVIDIA Vera and why it matters far beyond another chip announcement.
Vera is NVIDIA’s new data center CPU, but the bigger story is NVIDIA’s push to define the full AI factory architecture — CPU, GPU, memory, networking, interconnect, security, rack design, and software working together as one system.
Gary and Scott explain why the AI conversation is moving beyond GPUs alone. As AI shifts from simple chatbots to agents that retrieve data, call tools, use APIs, check permissions, and complete real business workflows, the infrastructure around the GPU becomes increasingly important.
The episode covers how Vera works with NVIDIA’s Rubin GPUs, NVLink, ConnectX networking, BlueField DPUs, and OEM systems from companies like Dell and Supermicro to support high-volume agentic AI workloads. The hosts also discuss why this matters for hyperscalers, neoclouds, colocation providers, mid-large enterprises, and even smaller AI-native companies where inference cost, latency, and model performance directly affect product margins.
The key takeaway: Vera is partly a cost optimization story. Not because CPUs replace GPUs, but because better architecture keeps expensive GPUs focused on high-value computation instead of wasting time on coordination, data movement, or system overhead.
For CIOs and AI product leaders, Vera raises a critical question: where should each AI workload run? Some AI belongs on the PC, some in SaaS, some in public cloud, some in neoclouds, and some in private or colocated AI factories.
Enterprise AI is becoming a distributed system — and the winners will be the companies that understand which workloads belong where.
Send a Text to the AI Guides on the show!
About your AI Guides
Gary Sloper
https://www.linkedin.com/in/gsloper/
Scott Bryan
https://www.linkedin.com/in/scottjbryan/
Macro AI Website:
https://www.macroaipodcast.com/
Macro AI LinkedIn Page:
https://www.linkedin.com/company/macro-ai-podcast/
Gary's Free AI Readiness Assessment:
https://macronetservices.com/events/the-comprehensive-guide-to-ai-readiness
Scott's Content & Blog
https://www.macronomics.ai/blog
Popular Podcasts
Hey Jonas!
Hey Jonas! The official Jonas Brothers podcast. Hosted by Kevin, Joe, and Nick Jonas. It’s the Jonas Brothers you know... musicians, actors, and well, yes, brothers. Now, they’re sharing another side of themselves in the playful, intimate, and irreverent way only they can. Spend time with the Jonas Brothers here and stay a little bit longer for deep conversations like never before.
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com