A panel discussion with AI industry leaders revealing how enterprises are scaling AI today, with predictions on coming breakthroughs for AI and the impact on Fortune 500 companies and beyond.
Topics Include:
- Three technical leaders discuss production challenges: security, interoperability, and scaling agentic systems
- Panelists represent Enkrypt (security), Anyscale (infrastructure), and CrewAI (agent orchestration platforms)
- Industry moving from flashy demos to dependable agents with real business outcomes
- Breakthrough examples include 70-page IRS form processing and multimodal workflow automation
- Multimodal data integration becoming crucial - incorporating video, audio, screenshots into decisions
- Less than 10% of future applications expected to be text-only
- Companies shifting from experimenting with individual models to deploying agent networks
- Need for governance frameworks as enterprises scale to hundreds of agents
- Growing software stack complexity requires specialized infrastructure between applications and GPUs
- Security teams need centralized visibility across fragmented agent deployments across enterprises
- Existing industry regulations apply to AI services - no special AI laws needed
- Interoperability standards debate: MCP gaining adoption while A2A seems premature solution
- MCP shows higher API reliability than OpenAI tool calling for implementations
- Multimodal systems more vulnerable to attacks but value proposition too high ignore
- Fortune 500 company automated price operations approval process using 630 brands data
- 87% of enterprise customers deploy agents in private VPCs or on-premises infrastructure
- Specialized AI systems needed to oversee other agents at machine speed scales
- Cost optimization through model specialization rather than always using most powerful models
- Future learning may happen through context/prompting rather than traditional weight fine-tuning
- Predictions include AI meeting moderators and agents working autonomously for hours
Participants:
- Robert Nishihara - Co-founder, Anyscale
- João Moura - CEO, CrewAI
- Sahil Agarwal - Co-Founder & CEO, Enkrypt AI
- Jillian D’Arcy - Sr. ISV Sales Leader, Amazon Web Services
Further Links:
- Anyscale – Website | LinkedIn | AWS Marketplace
- CrewAI - Website | LinkedIn | AWS Marketplace
- Enkrypt AI - Website | LinkedIn | AWS Marketplace
See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
Cardiac Cowboys
The heart was always off-limits to surgeons. Cutting into it spelled instant death for the patient. That is, until a ragtag group of doctors scattered across the Midwest and Texas decided to throw out the rule book. Working in makeshift laboratories and home garages, using medical devices made from scavenged machine parts and beer tubes, these men and women invented the field of open heart surgery. Odds are, someone you know is alive because of them. So why has history left them behind? Presented by Chris Pine, CARDIAC COWBOYS tells the gripping true story behind the birth of heart surgery, and the young, Greatest Generation doctors who made it happen. For years, they competed and feuded, racing to be the first, the best, and the most prolific. Some appeared on the cover of Time Magazine, operated on kings and advised presidents. Others ended up disgraced, penniless, and convicted of felonies. Together, they ignited a revolution in medicine, and changed the world.