E038 - AI or Not - Evan Benjamin and Pamela Isom

Welcome to "AI or Not," the podcast where we explore the intersection of digital transformation and real-world wisdom, hosted by the accomplished Pamela Isom. With over 25 years of experience guiding leaders in corporate, public, and private sectors, Pamela, the CEO and Founder of IsAdvice & Consulting LLC, is a veteran in successfully navigating the complex realms of artificial intelligence, innovation, cyber issues, governance, data management, and ethical decision-making.

The rapid advancement of artificial intelligence has created an urgent need for a deeper understanding beyond basic prompt engineering. In this illuminating conversation with Evan Benjamin, a senior project delivery consultant and AI specialist, we uncover the critical infrastructure considerations that are often overlooked in the rush to adopt the latest AI technologies.

Evan shares his remarkable journey from legal tech expert to AI infrastructure specialist, highlighting how the worlds of e-discovery and generative AI have converged in unexpected ways. What began as attorneys experimenting with prompts has evolved into complex, multi-agent systems that require entirely new approaches to implementation and security.

One of the most compelling insights centers on how organizations approach AI tools—treating them as simple product upgrades rather than fundamentally different technologies with unique security implications. "We're beta testers for OpenAI and Anthropic, but we're completely neglecting our own privacy and security," Evan warns. This cavalier approach extends to skipping essential documentation, such as model cards, which contain critical information about capabilities and limitations.

We explore the evolution of threat modeling for AI systems, examining why traditional cybersecurity frameworks, such as STRIDE or PASTA, cannot be applied directly to AI environments. New frameworks such as MAESTRO (designed specifically for multi-agent environments) and the OWASP Top 10 for LLMs represent more appropriate approaches for identifying AI-specific threats. With new attack surfaces emerging through agentic AI, organizations must adapt their security practices accordingly.

The conversation takes a fascinating turn toward AI literacy, particularly examining how the EU AI Act establishes a higher standard than many organizations currently achieve. While companies claim to prioritize AI adoption, true literacy extends far beyond basic prompt abilities to comprehensive knowledge of the AI lifecycle. This literacy gap presents significant challenges but also opportunities for those willing to invest in deeper understanding.

As we transition from the era of LLMs to what Evan calls "the year of agents and agentic AI," your organization's approach to implementation, security, and governance must evolve in tandem with the technology. Take the first step today by committing to improve your AI knowledge by just 2% daily—whether through videos, books, or articles—and watch how quickly your understanding transforms.