602. Jacob Bank, Founder of Relay.app, No-code AI Agents

Show Notes

Jacob Bank, founder and CEO of Relay.App, talks about the rise of AI agents, a type of chatbot that can work on your behalf in the background. He explains that AI agents can perform tasks similar to junior-level employees or interns. 

How AI Agents Work

An example of an AI agent working on your blog post is Chat GPT, which can automatically draft a blog post about a new recipe. The agent may ask for feedback and then publish it for you. This makes AI agents less of a thought prompt partner and more like an intern who takes on a mission on your behalf. There are two ways AI agents can take action on your behalf: making direct computer calls called API calls, or controlling your computer. API calls allow agents to make direct connections with tools like Salesforce, Calendly, Microsoft Teams, Google Calendar, and HubSpot. The second approach involves the AI controlling your computer, i.e., constantly looking at the screen and clicking buttons on it. Relay.App focuses on business productivity applications and automated calls, so it cannot log into your bank and perform actions on your behalf. However, a tool using the computer use capability would need two factor authentication and captcha.

AI Agent Interaction: Solutions and Problems

AI agents can interact with any website or tool that has an API, such as email browsers, CRM systems, and business productivity tools. There are three categories of AI agents: APIs, which perform tasks on a computer screen, AI in-built capabilities, and capabilities in reasoning. One problem AI agents need to solve is how they interact with their tools, such as reading and writing data from Salesforce, and how they can do this either via an API or by controlling the browser. Additionally, AI agents have the ability to extract information from PDFs, translate language information, turn text to speech, create videos automatically, and browse the web and do research.

Three Models of AI Agents

There are three models of AI agents to keep in mind: one class is a tool like relay.app, where the tool comes on your cloud or services, and interacts with things, while another class is a tool owned by the customer or freelancing agents. Models to consider when building AI agents: pre-built AI agents, which are commonly used in customer support tools, custom AI agents, and freelancing agents. These models are designed for specific vertical use cases and can be hosted on a platform or servers. AI agents can interact with various tools and platforms, including email marketing tools, CRM systems, and cloud-based versions of Microsoft tools. They can also perform tasks such as transcription, summary notes, and internet research.

Customer Service Agents

Customer service agents can be trained on a company's knowledge base. These agents can take various actions, such as replying to emails, triggering password reset emails, or issuing refunds. There are three main types of customer support agents: pre-built agents for specific use cases, custom built agents on easy-to-use platforms like lyndee.ai, relevance.ai, and Zapier, and engineers building their own agents using developer-focused frameworks. There are two options for building agents: one that interacts with APIs, and another that almost takes over your desktop. The fully browser-based approach is less reliable and predictable, but API-based ap