In this episode of The Macro AI Podcast, hosts Gary and Scott dive deep into the world of Artificial Intelligence Centers of Excellence (AI CoEs), exploring their evolution, strategic importance, and practical steps for building high-impact CoEs in 2025. With 42% of U.S. enterprises now leveraging AI CoEs (up from 37% last year, per Deloitte), these hubs are critical for aligning AI innovation with business goals, ensuring ethical governance, and driving measurable ROI.
The episode traces the history of CoEs from their 1990s origins in IT and quality control to their modern role as strategic engines for AI innovation. Gary and Scott discuss how early adopters like JPMorgan Chase and Siemens used CoEs for fraud detection and manufacturing optimization, while contemporary examples like Cleveland Clinic’s 2024 CoE showcase multimodal AI for personalized medicine.
Listeners will learn key steps for building an AI CoE, including securing C-suite sponsorship (backed by a 2025 McKinsey study), assembling multidisciplinary teams with roles like AI strategists and ethicists, and prioritizing quick-win projects to demonstrate value. The hosts also break down three organizational models—Centralized, Federated, and Hybrid—offering insights on their pros, cons, and best use cases, supported by examples like Walmart’s hub-and-spoke approach.
The episode addresses challenges like talent shortages and governance risks, while highlighting strategies to foster enterprise-wide innovation through hackathons, shared resources, and agile methodologies. Looking ahead, Gary and Scott explore emerging trends like multimodal AI, federated learning, and quantum computing, emphasizing the role of CoEs in navigating regulations like the EU AI Act and driving sustainability.
Perfect for executives and AI enthusiasts, this episode offers actionable insights for transforming AI from a concept into a competitive differentiator. Tune in to learn how to structure and scale an AI CoE for enterprise success!
Send a Text to the AI Guides on the show!
About your AI Guides
Gary Sloper
https://www.linkedin.com/in/gsloper/
Scott Bryan
https://www.linkedin.com/in/scottjbryan/
Macro AI Website:
https://www.macroaipodcast.com/
Macro AI LinkedIn Page:
https://www.linkedin.com/company/macro-ai-podcast/
Gary's Free AI Readiness Assessment:
https://macronetservices.com/events/the-comprehensive-guide-to-ai-readiness
Scott's Content & Blog
https://www.macronomics.ai/blog
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
New Heights with Jason & Travis Kelce
Football’s funniest family duo — Jason Kelce of the Philadelphia Eagles and Travis Kelce of the Kansas City Chiefs — team up to provide next-level access to life in the league as it unfolds. The two brothers and Super Bowl champions drop weekly insights about the weekly slate of games and share their INSIDE perspectives on trending NFL news and sports headlines. They also endlessly rag on each other as brothers do, chat the latest in pop culture and welcome some very popular and well-known friends to chat with them. Check out new episodes every Wednesday. Follow New Heights on the Wondery App, YouTube or wherever you get your podcasts. You can listen to new episodes early and ad-free, and get exclusive content on Wondery+. Join Wondery+ in the Wondery App, Apple Podcasts or Spotify. And join our new membership for a unique fan experience by going to the New Heights YouTube channel now!
24/7 News: The Latest
The latest news in 4 minutes updated every hour, every day.