All Episodes

October 9, 2025 38 mins

How can you measure ROI on GenAI for your team? 🤔

Internal evaluations and intentionality. 

We've helped thousands of orgs put LLMs to work and ACTUALLY save time. On today's show, we're dishing the 7 steps you need to follow. 

What’s the best LLM for your team? 7 Steps to evaluate and create ROI for AI -- An Everyday AI chat with Jordan Wilson


Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion on LinkedIn: Thoughts on this? Join the convo on LinkedIn and connect with other AI leaders.

Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: info@youreverydayai.com
Connect with Jordan on LinkedIn


Topics Covered in This Episode:

  1. Choosing the Right Large Language Model
  2. Evaluating LLMs for Business ROI
  3. Front-End AI Operating Systems Explained
  4. Common Traps in AI Model Evaluation
  5. Public Benchmarks for LLM Evaluation
  6. Seven-Step LLM Evaluation Framework
  7. Measuring Pre-GenAI Human Baselines
  8. Building Realistic AI Test Datasets
  9. Calculating ROI for GenAI Implementation
  10. Monthly Retesting and AI Model Updates


Timestamps:

00:00 Choosing the Right AI Model

07:02 Adapting Workflows for AI Integration

10:58 "Gemini's Versatile Modes Overview"

14:30 Avoiding AI Shiny Object Syndrome

15:36 AI Evaluation for Reliability and Improvement

20:36 "Data Testing Guide Essentials"

25:15 Realistic and Messy Data Essentials

26:06 "Building Effective AI Workspaces"

31:08 AI Evaluation and ROI Calculation

34:11 Human Oversight in AI Testing

35:52 Evaluating GenAI Use Cases

39:00 "NotebookLM: AI-Powered Idea Organizer"


Keywords:

Large Language Model, LLM, generative AI, AI operating system, front end AI models, AI evaluation, model ROI, model evaluation steps, AI benchmarks, scientific benchmarks, API connection, enterprise AI, ChatGPT, Claude, Gemini, Copilot, team AI adoption, knowledge worker AI, operating system choice, productivity modes, connectors, deep research mode, agent mode, image generation, web search, Canvas mode, advanced voice mode, business process automation, workflow evaluation, change management, AI training, 



Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)

Mark as Played

Advertise With Us

Popular Podcasts

CrimeLess: Hillbilly Heist

CrimeLess: Hillbilly Heist

It’s 1996 in rural North Carolina, and an oddball crew makes history when they pull off America’s third largest cash heist. But it’s all downhill from there. Join host Johnny Knoxville as he unspools a wild and woolly tale about a group of regular ‘ol folks who risked it all for a chance at a better life. CrimeLess: Hillbilly Heist answers the question: what would you do with 17.3 million dollars? The answer includes diamond rings, mansions, velvet Elvis paintings, plus a run for the border, murder-for-hire-plots, and FBI busts.

Crime Junkie

Crime Junkie

Does hearing about a true crime case always leave you scouring the internet for the truth behind the story? Dive into your next mystery with Crime Junkie. Every Monday, join your host Ashley Flowers as she unravels all the details of infamous and underreported true crime cases with her best friend Brit Prawat. From cold cases to missing persons and heroes in our community who seek justice, Crime Junkie is your destination for theories and stories you won’t hear anywhere else. Whether you're a seasoned true crime enthusiast or new to the genre, you'll find yourself on the edge of your seat awaiting a new episode every Monday. If you can never get enough true crime... Congratulations, you’ve found your people. Follow to join a community of Crime Junkies! Crime Junkie is presented by audiochuck Media Company.

Stuff You Should Know

Stuff You Should Know

If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.

Music, radio and podcasts, all free. Listen online or download the iHeart App.

Connect

© 2025 iHeartMedia, Inc.