How the AI Chatbot for Customer Service Became the AI Agent (And How It Actually Works)

Key Takeaways

  • Customer service chatbots have evolved dramatically — from simple rule-based decision trees in the 1960s to today’s sophisticated AI-powered agents built on large language models that can handle complex queries and deliver consistent support.
  • AI agents differ fundamentally from older chatbots — they pursue goals, take autonomous actions, integrate with backend systems, and can manage complex requests that previously required human agents.
  • Boosting customer satisfaction is the core business case: modern AI chatbots provide instant answers, offer multilingual support across multiple channels (messaging apps, mobile apps, call centers), and are available 24/7.
  • Freeing human agents from repetitive tasks and routine inquiries allows customer support teams to focus on complex issues that require empathy and nuanced judgment, improving overall efficiency.
  • Lowering operational costs while improving customer experience is achievable by automating responses to routine inquiries, enabling businesses to scale support without proportionally scaling headcount.

 

Chatbots have become a staple in customer service for brands across the world. This is why eight out of ten businesses have some kind of chatbot in customer service on their website.

And it’s not hard to see why, as there are myriad benefits to using such AI customer service chatbots. They’re available 24/7, without having to take breaks or sick days; they’re able to handle multiple conversations simultaneously; they’re cost efficient and scalable; they can personalize queries to each individual (more on this shortly); and they boost customer satisfaction.

Perhaps this is why the chatbot market was thought to be worth nearly $5 billion in 2022, a figure estimated to triple before the end of this decade.

But having said that, there’s a lot of diversity hidden under the ‘chatbot’ label. There are many techniques for building customer service chatbots, these techniques have changed over time, and today, there are ‘AI agents’ which need to be distinguished from the older chatbots they replaced.

This is what we’re here to discuss today. We’ll first define AI chatbots in the context of customer support, provide an overview of their history, and how they’re different from the agents rapidly changing the contact center industry.

What is an AI Chatbot for Customer Service?

An AI customer service chatbot refers to a program, platform, or machine-learning model that can perform some fraction of the work done by customer service agents.

Customer service chatbots vary widely in complexity.

First, there were the simple rule-based systems of yesteryear that attempted to understand the customer’s intent and match it to an appropriate, pre-defined response.

Over time, advances in machine learning, natural language processing, and data storage led to the billion-parameter large language models we use now, which can respond flexibly and dynamically under a range of circumstances, even to questions that are ambiguous or contradictory.

These are incredibly different offerings, but we won’t do more than point that out for now, as this will be our focus for most of the rest of the piece.

Regardless, an customer support chatbot generally lives on a company’s website, where it can answer questions. It has also become common to integrate them into various communication channels, such as Apple Messages for Business, WhatsApp, Voice, and email — as well as messaging apps and mobile apps — providing instant support across multiple channels to global customers.

Though there are critical aspects of human interactions that are still not outsourceable to algorithms, customers have gradually become more willing to talk directly to AI chatbots to resolve their customer support issues.

Surveys have shown that almost everyone has heard of chatbots and understands in general terms what they are. And nearly three-quarters of respondents prefer chatbots over humans to quickly get simple questions answered. When asked whether they were satisfied with their last interaction with a chatbot, 69% said ‘yes,’ and a little over half cited long wait times as one of their chief frustrations.

Benefits of AI-Powered Chatbots for Customer Support Teams

Before diving into the history and evolution, it’s worth understanding why AI-powered chatbots have become so essential for support and service teams of all sizes.

  • Lowering operational costs: By automating responses to common customer questions and routine inquiries, businesses can dramatically reduce the burden on human staff, so they can focus on complex issues that require real empathy and judgment.
  • Improving customer satisfaction: Providing instant answers to customer inquiries — even at 2 AM — has a measurable impact on customer sentiment. Customers expect immediate support, and AI-powered chatbots that deliver consistent and accurate responses go a long way toward meeting those rising customer expectations.
  • Operational efficiency: A well-configured chatbot platform can handle thousands of support requests simultaneously, enabling a lean support team to deliver consistent support without proportionally growing headcount. Automated workflows also reduce errors and speed up resolution times.
  • Understanding customer behavior: Modern AI chatbot platforms collect rich customer data on customer interactions, customer preferences, and user preferences, giving businesses the tools to understand customer behavior and proactively improve customer service.

How AI Chatbots Have Evolved to Improve Customer Support

As promised, let’s now discuss some of the ways in which the customer service AI chatbot has changed over time.

Here’s a broad overview, taken from TechTarget:

The Evolution of Chatbots

What are the Kinds of AI Chatbots in Customer Service?

You’ll notice the chart above tracks three broad types of customer service chatbots, which is a categorization we more or less agree with—though we think there’s an important distinction between chatbots and agents, which isn’t reflected here.

The first kind of chatbot to be developed was by far the simplest, and it emerged from research done in the 1960s. These were based on a primitive model known as a ‘decision tree,’ and were only suitable for basic, formulaic interactions where there were clear rules and virtually no room for either ambiguity or creativity. In call centers and contact centers, robust AI agents are replacing these, but you might still see them answering the most common questions.

Although there was a lot of research into methods like neural networks, these ‘scripted chatbots’ were more or less the standard for the next four decades, until the field of natural language processing made enough progress to power a different approach.

Once it became possible to use sentiment analysis to detect emotional tones in writing, and entity extraction to automatically detect information like product names and formal titles (to pick just two examples), the road was paved to create more powerful ‘conversational interfaces’ and chatbots that could better simulate human conversation.

Unlike their predecessors, these chatbots could carry on much longer-range, multi-turn interactions, and improve customer support in a much broader variety of circumstances. Common examples of these tools are Siri and Alexa, both of which can process voice commands, look things up, fetch information, and even perform simple tasks (like scheduling a meeting or adding a reminder to your calendar).

Then, we come to the modern crop of artificial intelligence chatbots, which are so much more powerful and far-reaching it’s better to call them ‘agents’ instead of ‘chatbots.’ These ‘generative AI agents’ are built around large language models, made famous by the release of ChatGPT in November of 2022.

For the most part, AI agents aren’t actually a new kind of technology, as neural networks have been around for a while and have been used in chatbots for a while, too. No, the single biggest distinguishing feature is that the networks are so big and are trained on such a bewildering variety of data that they can do things prior iterations couldn’t do.

No doubt you’ve spent some time playing with these models, or you’ve seen demonstrations of them, and you know what we mean. They can write code and poems, translate near-instantaneously between dozens of languages — offering multilingual support to global customers — describe (and generate) images (and videos), and take on all sorts of subtle postures in their interactions with humans. They can be instructed to act like a kindly grandma, for example, a stern teacher from fifth-grade, or an exceptionally polite and deferential friend.

This is precisely the reason that generative AI is having such a profound impact on contact centers. It can do so many things, and there are so many ways to fine-tune and tweak it, that people are finding dozens of places to use it. It’s not so much replacing human agents as it is dramatically simplifying and accelerating their workflows in hundreds of little ways.

AI Chatbots vs. AI Agents

Okay, now let’s get to the main distinction we want to draw out in this piece, the one between ‘AI chatbots’ and ‘AI agents’. In doing so, we’ll provide CX leaders with the valuable context they need to make the best decisions about the technological tools they deploy and invest in.

First, we’ve already written a lot about customer service chatbots, so let’s define an ‘agent.’

Broadly speaking, an agent is an entity that can take one or more actions in pursuit of an overarching goal. Some agents are very simple, like single-celled organisms that just sort of float around looking for food, while some are very complex, such as the humans working out ways to terraform Mars.

But what they all have in common is a goal.

An AI agent is the same thing. It’s an artificial entity that can usually achieve a goal, like ‘download these data files and create a line chart with them’ or ‘check these six sources on quantum computing and summarize your findings.’ Unlike a basic chatbot, it doesn’t just spit out answers — it takes action, leverages a knowledge base, enables seamless integration with other tools, and manages complex queries end-to-end.

As with chatbots more generally, agents aren’t exactly new. We’ve been working with reinforcement learning agents for years, for example. But generative AI has opened up a whole new frontier, and the agent projects being built on top of it are really exciting.

A full discussion of this frontier is outside the scope of this article, but you can check out our piece on the future of generative AI for a discussion of specific agent projects.

How a Chatbot Integrated into Customer Service Actually Works

A modern chatbot integrated into a company’s customer experience stack follows a general process when handling customer interactions:

  • Receiving and parsing the query: When a customer sends a message, the AI-powered chatbot uses natural language processing to understand customer’s intent — even when phrased ambiguously.
  • Searching the knowledge base: The chatbot queries a structured knowledge base or connected data sources (CRMs, product feeds, order management systems) to retrieve relevant information. This retrieval-augmented generation grounds the response in facts rather than guessing.
  • Generating and delivering the response: The AI chatbot platform formulates instant responses.
  • Escalating complex issues: When complex issues arise that are beyond the chatbot’s scope, the system routes the conversation to human agents — ensuring that human support is available when it matters most.
  • Collecting customer feedback: After resolution, well-configured automated workflows capture customer feedback and customer data to continually improve customer service over time.

7 Best Practices for Using AI Agents to Deliver Consistent Support

What does concern us here is the impact this will have on CX leaders and the contact centers they manage, which is why we’ll cover some of the best practices of successfully using AI agents in this section.

1. Start with a single use case, like self-service options.

As we’ve already mentioned, generative AI is great at many tasks, but the way to get the most out of it is to identify which KPIs you’re trying to drive and what changes you want to see, then implementing an agent that can help get you there.

Starting with self service options for routine inquiries is a proven entry point. Don’t be overwhelmed by its possibilities; start by drilling down into a few promising use cases and expand as appropriate.

2. Focus on design and access for customer satisfaction and adoption.

You want to be sure that the conversational interfaces customers use to interact with your customer support chatbot are sleek, intuitive, and easy to find across multiple channels — including messaging apps.

You can have the most powerful AI chatbot platform in the world, but it won’t do you much good if people hate using it or they can’t locate it in the first place.

3. Use full personalization in instant answers.

One of the reasons modern AI-powered chatbots are so powerful is that they can use retrieval-augmented generation to ‘ground’ their generations in sources of information —knowledge bases, product feeds, CRMs, Notion pages, etc.

This makes replies more useful, while also making your customers feel more heard. So make sure your AI agent has access to the systems or customer data it needs to take action (as you would with a new employee).

4. Gather feedback and improve backend systems.

AI agents are capable of being improved in a bevy of different ways. You should implement systems to gather customer feedback, and use it to update your backend systems accordingly.

Monitoring chatbot performance regularly ensures you’re continuously improving customer satisfaction and adapting to shifting customer expectations.

5. Let AI and humans play their strongest roles.

AI agents are great at many tasks, but complex requests and emotionally sensitive customer issues need a human’s superior flexibility and insight.

The key here is to craft a system that can seamlessly switch between human agents and AI — guiding customers through self service options before escalating to human support when needed. Enabling businesses to blend AI and human expertise is the hallmark of a mature customer experience strategy.

6. Have your AI agents be proactive in customer interactions.

AI agents can be configured to reach out on their own if a user engages in certain behaviors or otherwise seems confused. This proactive support approach is one of the most powerful ways to improve customer sentiment in real time.

For example, one well-known furniture brand and Quiq customer implemented Proactive AI and a Product Recommendation engine, which led to the largest sales day in the company’s history through increased chat sales.

7. Ensure transparency.

Most of us are really excited about the promise of generative AI, but one thing that has many concerned is the way customer data is used by these models, and their broader implications for privacy. Make your policies clear, and make sure you are being responsible with the data your customers trust you with. Transparent data practices build the trust needed to improve customer support relationships over the long term.

You can use these best practices when designing your own AI agent system, but the easier way forward is to treat them as a checklist when you’re shopping around for third-party platforms.

AI Agents and You

Large language models, and the AI agents they make possible, will be a key part of the future of contact centers. If you want to learn more about this technology and the ways to harness it to redefine CX success, check out our latest guide.

Frequently Asked Questions (FAQs)

What should I look for in an AI chatbot platform?

When evaluating an AI chatbot platform, look for seamless integration with your existing systems, strong natural language processing capabilities, support for multiple channels (web, mobile apps, messaging apps), robust customer data and analytics for monitoring chatbot performance, and the ability to escalate complex queries to human agents without friction. Also prioritize platforms that enable proactive support and can adapt to customer preferences over time.

What is natural language processing and why does it matter for customer support chatbots?

Natural language processing (NLP) is the branch of artificial intelligence that enables computers to understand and generate human language. For customer support chatbots, NLP is what allows the system to interpret customer’s intent — even when phrased in different ways — and deliver instant responses that feel natural. Without NLP, chatbots are limited to rigid, script-based replies that frustrate customers.

What is the difference between a customer service chatbot and an agentic AI agent?

A customer service chatbot typically handles routine inquiries using rule-based logic or basic natural language processing to provide accurate answers to common customer queries. An agentic AI agent, by contrast, can pursue complex goals autonomously — integrating with your systems, managing complex requests, and executing automated workflows to fully resolve customer issues without human intervention.

These are the Most Essential Customer Service Chat Platform Types

Customer service has come a long way since the first contact centers. These days, most complaints are dealt with through a customer service platform, and those platforms are often focused on using chat to communicate.

In this piece, we’ll discuss customer service chat platforms, comparing various features you should be looking out for and how they’ll help your business. Let’s get going!

Key takeaways:

  • Customer service remains incredibly important, and there’s a ton of data to back that up.
  • More and more companies are turning to customer service platforms because they help you fit better into busy customers’ schedules, leverage advanced tools like generative AI, and provide a world-class experience.
  • When evaluating a potential platform, there are a few things you should keep in mind. It should support many different channels (from email and voice to Facebook Messenger and Wechat), it should allow you to have humans do what they’re best at and AI systems do what they’re best at, and you should be able to build a CRM, helpdesk, knowledge base, or agent workspace on top of it without too much difficulty.

Why You Should Be Using a Customer Service Chat Platform

As professionals in the customer service arena, you probably already understand why it’s important to have a dedicated customer service platform–especially when it enables chat.

Still, it’s worth pointing out how compelling the data supporting this conclusion is. High-quality customer service is a huge selling point, as 4 out of 10 customers indicate they will split with a business over bad service (this figure has been considerably higher in prior years). All told, it’s been estimated that U.S. businesses have lost as much as $1.6 trillion when customers switch after having a bad encounter with customer service.

On the other hand, the data also paints a clear picture of how valuable your reputation can be, as 68% of survey respondents have said they will select your company if you are well-known for being helpful and courteous.

How Can a Chat-Based Customer Service Platform Help?

Having said that, here are some of the high-level benefits that accrue to companies that invest in good customer service chat platforms:

  • Meeting your customers where they’re at: A good platform will give you many ways of talking to your customers, which means they can choose the option that makes the most sense given their schedules and preferences. Consult the next section for more information on customer service chat channels.
  • You can integrate with generative AI: The big story of the past few years has been the rise of large language models, with concomitant changes in how contact centers run. You’ll want to vet your platforms to make sure they’ll allow you to leverage this technology–as well as related abilities like advanced natural language processing and sentiment analysis–as it’s rapidly becoming tablestakes.
  • Personalization: One of the other significant applications of modern machine learning is tailoring content to each person’s tastes (think of how Netflix or Spotify learn what shows and music you like and recommend more of it). Using something like retrieval-augmented generation (RAG), you can draw on a customer’s prior interactions or purchases to answer their questions in a way that speaks to their unique circumstances.
  • You can gather better data for KPIs: It’s hard to know whether your strategies are working unless you have the right data. Quality customer service platforms make gathering and analyzing customer data a breeze.
  • Your agents can be more productive: Between generative AI, automation features, self-serve, and live chat, a customer service chat platform can make your agents far more effective. This acts to boost customer satisfaction and agent satisfaction at the same time.

The Main Customer Service Chat Channels–And How to Use Them

Okay, now let’s discuss some available options. There’s a lot to cover here, so we’ve chosen to break things up like this:

  • Customer service channels are the actual applications you use to talk to your customers, like voice chat, email, SMS, Apple Messages for Business, or WhatsApp.
  • Customer service modes are what we call the ways you use your channels, with the three big categories being “speaking to a human agent,” “speaking with an AI agent,” and “speaking with a mix of both.”
  • Customer service platforms are what we call products like Quiq, Zendesk, etc., that serve these capabilities through a user interface.

In the sections below, we’ll discuss all three.

The Major Customer Service Channels

  • Web chat has become a standard-issue channel for many websites. Everyone from energy companies to car dealerships has a portal on their web pages that allows you to speak with either a human or AI agent, and this is something you should offer as well.
  • SMS and rich chat are both crucial channels, given how prevalent phones have become. Many customers find they prefer the convenience of dealing with agents through text messages, as this enables asynchronous conversations that fit better into busy lives. Through multimedia messaging service (MMS), SMS can send more than text–it can handle pictures, videos, emojis, audio, buttons, carousel cards, quick replies, and more. Rich messaging supports this natively, so you have multiple options for creating engaging interactions with your customers.
  • Voice (over the phone) was once one of the dominant ways of handling customer service issues. Though it has lost a lot of ground to texting, email, and chat, it’s still worth having a phone number people can call if they need to.
  • Email is, of course, thoroughly embedded into modern life, and is a common way of communicating. You’re almost certainly already supporting email, and if you’re not, you should be.
  • WhatsApp for Business–a messaging, voice, and video-calling application managed by Meta–boasts over two billion users worldwide. Given its widespread use for texting, it has become a favored platform for businesses looking to utilize instant messaging for commercial purposes.
  • Facebook Messenger is another service Meta provides that customer-centric businesses should consider, especially due to its large user base. Furthermore, companies implementing effective automation solutions on Facebook Messenger can respond to 80% of incoming customer inquiries and attain customer satisfaction rates up to 95%.
  • Instagram Messenger is important because many members of your audience are already engaging with businesses on the widely-used Instagram platform. Additionally, its appealing API facilitates the setup of automation, enhancing the efficiency of your business.
  • Apple Messages for Business greatly enhances your customers’ access to your business by providing a “message” icon on Maps, Siri, Safari, Spotlight, or your company website, along with other contact options such as QR codes. Furthermore, the widespread popularity of Apple and its product ecosystem underscores why you should be investing in its instant messaging capabilities.
  • WeChat is an extremely popular platform in China, boasting over a billion users. Similar to the other platforms we’ve discussed, WeChat offers a Business version that enables you to interact with customers, market your services, and process payments. However, setting up a WeChat Business account requires verification of your business license. If you have a substantial customer base in China, this could be the optimal choice.
Convenient  Asynchronous Scalable AI integrations
Web chat Limited Limited Yes Yes
SMS, MMS, and Rich Messaging Yes Yes Yes Yes
Voice Limited No No (but will become more scalable as AI voice models improve, see next column) Kind of (voice models are getting good, and the best vendors already have multimodal voice support.)
Email Limited Yes Yes Yes
Messaging Application (Facebook, WhatsApp, etc.) Yes Yes Yes Yes

The Major Customer Service Modes

Now, let’s discuss the basic ways of using a customer service communication channel.

Human agents
Obviously, the original way of solving issues was to have a human manually walk through all the steps. The customer service industry remains large in part because there are many aspects of the “human touch” that cannot be automated or replaced.

This is one huge advantage of using human agents, and it’s why we’ll still need humans for a long time. The downside, of course, is that people need breaks, time off, and to sleep, or else they’ll burn out.

AI agents
Until just a few years ago, the best we could do with AI systems was build brittle, rule-based chatbots that were of limited use. That’s no longer the case, and today’s language models can handle many queries directly, or else route to the most qualified human being.

The advantages of AI agents are that they can scale almost infinitely, can work all day and night, and can almost instantly handle complex tasks like translating between different natural languages. The disadvantage of AI agents is that there are still many issues that they simply can’t handle.

A mix of both
But the real power lies in what are commonly called “centaurs,” i.e., systems combining human ingenuity and flexibility with the scalability of AI.

This will look different for different situations, but a common centaur setup is to have routine issues solved by an AI agent, and everything else sent to a human based on its content and priority. Even then, however, AI can be of enormous use. Quiq’s Human-Agent Assistants, for example, use AI to suggest replies to humans, making both the AI component and the human component of the system more effective.

This means you can allow humans and machines to play to their respective strengths, but it can take time and effort to get everything configured and running smoothly.

Human agents AI agents Centaurs
Adaptable Yes Limited Yes
Infinitely scalable No Yes No
Needs breaks Yes No Yes (the human part)

How This Figures Into Picking the Right Customer Service Chat Platform

Now, we’ll close the section by discussing customer service chat platforms like Quiq.

Today, most of these platforms offer functionality like data tracking, CRMs, various communication channels, and native support for generative AI. If you choose a good one, you’ll be able to create reports about the effectiveness of different agents, how happy your customers are on average, how long it takes you to resolve issues, etc. They should also make it easy for you to incorporate your own data sources–a knowledge base, a product catalog, an API–so that you can personalize replies across channels.

Another thing to look out for is how easy a given platform makes it to set up a helpdesk or knowledge base (or to incorporate an external one). The former allows you to track tickets and manage your agent workflows (another thing that AI agents can help with), while the latter offers resources customers can use to resolve their own problems. Both are important.

CRM  Help Desk Knowledge Base Agent workspace
Supports customer segmentation and bespoke communication Yes Yes No Yes
Gives granular data insights into customers Yes No No Yes (but only if the vendor has robust data integrations)
Facilitates multi-channel communication Yes No No Yes
Supports templates Yes Yes Yes Yes
Enables automation Yes Yes Yes Yes
Can integrate with other tools (including AI) Yes Yes Yes Yes

Getting Customer-Centric Chat Right

We’ve offered a lot of context about how to think about customer service chat platforms, but one thing we haven’t discussed is the difference between rolling your own solution vs. going with a third-party platform.

It’s a big topic, involving non-trivial tradeoffs on either side. To get up to speed as quickly as possible, check out our whitepaper!