Once switched off during busy periods, Lloyds Banking Group’s chatbot now handles more than 15 million conversations a year. Learn what it really takes to build AI solutions that customers trust with their money.
We sit down with Cainan Wright, Senior Product Owner, and John Young, AI Lead - Chatbots and Generative AI, from Lloyds Banking Group, to explore their remarkable nine-year journey in building one of the UK's most successful banking chatbots. From handling 3 million conversations in 2021 to over 15 million in 2025, they share the hard-earned lessons of transforming a rather "unloved" virtual assistant into a mission-critical service for almost 27 million customers.
We cover how the team stabilised their service by focusing on the basics, investing in design expertise, and securing organisational buy-in through demonstrating clear value.
Cainan and John also share valuable insights into their pragmatic approach to generative AI, explaining how they combine deterministic processes with generative language capabilities to deliver the best customer experience while maintaining brand consistency and ensuring regulatory compliance.
The team's journey offers important lessons about perseverance and the importance of striking a balance between innovation and responsibility when deploying AI in a highly regulated industry.
Timestamps
00:00 – Intro
01:34 – Meet Lloyds Banking Group
03:18 – The unloved virtual assistant era
05:30 – AI before ChatGPT
06:50 – Stabilising the service and earning trust
14:23 – From underloved to mission critical
16:55 – Buy-in from stakeholders to scale AI capabilities
18:41 – Defining new AI roles in banking
20:51 – Scaling from 3 to 15 million conversations
25:15 – How to handle a 5x increase in three years
27:43 – Experiments with generative AI in banking
30:24 – Using an LLM classifier
31:07 – Improving tools within teams
32:45 – Using generative AI for value and impact
34:56 – Valuable design research sessions
38:56 – Meeting customer expectations with generative AI
46:04 – Maintaining consistency in probabilistic landscape
49:30 – The right tool for the right job in conversational AI
55:26 – How do you measure the impact of generative AI?
56:13 – Responsible AI and proving business value
1:01:10 – The next 12 months
1:07:02 – Magic wand moments
1:11:34 – If the team could start over again
1:14:03 – Closing remarks from Kane
Show notes
Take our updated AI Maturity Assessment
Subscribe to The AI Ultimatum Substack
Hosted on Acast. See acast.com/privacy for more information.
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
The Burden
The Burden is a documentary series that takes listeners into the hidden places where justice is done (and undone). It dives deep into the lives of heroes and villains. And it focuses a spotlight on those who triumph even when the odds are against them. Season 5 - The Burden: Death & Deceit in Alliance On April Fools Day 1999, 26-year-old Yvonne Layne was found murdered in her Alliance, Ohio home. David Thorne, her ex-boyfriend and father of one of her children, was instantly a suspect. Another young man admitted to the murder, and David breathed a sigh of relief, until the confessed murderer fingered David; “He paid me to do it.” David was sentenced to life without parole. Two decades later, Pulitzer winner and podcast host, Maggie Freleng (Bone Valley Season 3: Graves County, Wrongful Conviction, Suave) launched a “live” investigation into David's conviction alongside Jason Baldwin (himself wrongfully convicted as a member of the West Memphis Three). Maggie had come to believe that the entire investigation of David was botched by the tiny local police department, or worse, covered up the real killer. Was Maggie correct? Was David’s claim of innocence credible? In Death and Deceit in Alliance, Maggie recounts the case that launched her career, and ultimately, “broke” her.” The results will shock the listener and reduce Maggie to tears and self-doubt. This is not your typical wrongful conviction story. In fact, it turns the genre on its head. It asks the question: What if our champions are foolish? Season 4 - The Burden: Get the Money and Run “Trying to murder my father, this was the thing that put me on the path.” That’s Joe Loya and that path was bank robbery. Bank, bank, bank, bank, bank. In season 4 of The Burden: Get the Money and Run, we hear from Joe who was once the most prolific bank robber in Southern California, and beyond. He used disguises, body doubles, proxies. He leaped over counters, grabbed the money and ran. Even as the FBI was closing in. It was a showdown between a daring bank robber, and a patient FBI agent. Joe was no ordinary bank robber. He was bright, articulate, charismatic, and driven by a dark rage that he summoned up at will. In seven episodes, Joe tells all: the what, the how… and the why. Including why he tried to murder his father. Season 3 - The Burden: Avenger Miriam Lewin is one of Argentina’s leading journalists today. At 19 years old, she was kidnapped off the streets of Buenos Aires for her political activism and thrown into a concentration camp. Thousands of her fellow inmates were executed, tossed alive from a cargo plane into the ocean. Miriam, along with a handful of others, will survive the camp. Then as a journalist, she will wage a decades long campaign to bring her tormentors to justice. Avenger is about one woman’s triumphant battle against unbelievable odds to survive torture, claim justice for the crimes done against her and others like her, and change the future of her country. Season 2 - The Burden: Empire on Blood Empire on Blood is set in the Bronx, NY, in the early 90s, when two young drug dealers ruled an intersection known as “The Corner on Blood.” The boss, Calvin Buari, lived large. He and a protege swore they would build an empire on blood. Then the relationship frayed and the protege accused Calvin of a double homicide which he claimed he didn’t do. But did he? Award-winning journalist Steve Fishman spent seven years to answer that question. This is the story of one man’s last chance to overturn his life sentence. He may prevail, but someone’s gotta pay. The Burden: Empire on Blood is the director’s cut of the true crime classic which reached #1 on the charts when it was first released half a dozen years ago. Season 1 - The Burden In the 1990s, Detective Louis N. Scarcella was legendary. In a city overrun by violent crime, he cracked the toughest cases and put away the worst criminals. “The Hulk” was his nickname. Then the story changed. Scarcella ran into a group of convicted murderers who all say they are innocent. They turned themselves into jailhouse-lawyers and in prison founded a lway firm. When they realized Scarcella helped put many of them away, they set their sights on taking him down. And with the help of a NY Times reporter they have a chance. For years, Scarcella insisted he did nothing wrong. But that’s all he’d say. Until we tracked Scarcella to a sauna in a Russian bathhouse, where he started to talk..and talk and talk. “The guilty have gone free,” he whispered. And then agreed to take us into the belly of the beast. Welcome to The Burden.