Building Trustworthy AI: Navigating the Challenges and Future of Agentic Software with Shane Emmons

In this episode of The Innovators & Investors Podcast, host Kristian Marquez sits down with Shane Emmons, founder and CEO of Swept, to explore the complexities and challenges surrounding AI trust and reliability.

Shane explains why AI systems can behave unpredictably due to their probabilistic nature and the inherent uncertainty in their predictions. He delves into how Swept tackles these challenges by assessing AI agents’ consistency and enforcing hardline policies to prevent harmful or unintended outcomes, especially in sensitive fields like healthcare. They discuss the evolution of AI agents, from handling simple tasks to managing complex workflows through specialized sub-agents, highlighting recent breakthroughs that enhance reliability and practical business applications.

Shane also shares valuable advice for those looking to deepen their understanding of AI, emphasizing hands-on experimentation with popular models like ChatGPT and Claude. The conversation addresses the balance between AI’s benefits and risks, including ongoing efforts to detect misuse and “jailbreak” attempts, drawing parallels with cybersecurity.

Looking ahead, Shane paints a picture of AI’s transformative potential over the next decade—not just automating busy work but enabling new creative and strategic endeavors. The episode closes with Shane reflecting on his career journey and key lessons learned while building Swept, offering encouragement for businesses to pragmatically deploy AI while managing associated risks. This discussion offers a comprehensive look at AI’s current realities and future opportunities for innovators and investors alike.