Not ready to make use of Generative AI and LLMs? No problem. You don't need to incorporate these technologies into your solution. The choice is yours: Use Conversation Assist with or without Generative AI.
Introduction
If you’re using Conversation Assist to offer answer recommendations to your agents, you can offer ones that are enriched by KnowledgeAI's LLM-powered answer enrichment service. We call this offering Copilot Assist. The resulting answers, formulated via Generative AI, are:
- Grounded in knowledge base content
- Contextually aware
- Natural-sounding
Language support
Get started
Turn on enriched answers
You turn on enriched answers within the add-on of a rule. This means you can turn it on for some scenarios but not others.
Default prompt
To get you up and running quickly, Conversation Assist makes use of a default Enrichment prompt. An Enrichment prompt is required, and we don't want you to have to spend time on selecting one when you're just getting started and exploring.
Here's the default prompt that Conversation Assist passes to KnowledgeAI when requesting enriched answers:
In your knowledge base-related rules, use the default prompt for a short time during exploration. But be aware that LivePerson can change it without notice, altering the behavior of your solution accordingly. To avoid this, at your earliest convenience, duplicate the prompt and use the copy, or select another prompt from the Prompt Library.
You can learn more about the default prompt by reviewing its description in the Prompt Library.
Select a prompt
You select the prompt to use within the add-on of a rule. This means you can use one prompt in one scenario but a different prompt in another.
The process of selecting or changing a prompt is the same for the Enrichment prompt (required) and No Article Match prompt (optional).
- In the add-on of the rule, select the existing prompt to open the Prompt Library.
-
Do one of the following:
- If you're currently using the default system prompt, click Select from library in the lower-right corner.
- If you're using one of your own prompts, click Go to library in the lower-left corner.
By default, your prompts are listed in the Select Prompt window.
- In My Prompts, select the prompt that you want to use.
- Click Select.
Since you're accessing the Prompt Library from Conversation Assist, the system filters the available prompts to just those where the client type is "Conversation Assist."
Create or edit a prompt
When you need to create or edit a prompt, make sure to open the Prompt Library via the add-on of a rule within Conversation Assist. Don’t open the Prompt Library via another application like Conversation Builder or KnowledgeAI. If you do, your new or updated prompt won’t be available for use back in Conversation Assist. This is because Conversation Assist isn’t yet fully updated to reflect recent enhancements to the Prompt Library. But stay tuned; soon this constraint won’t exist!
Learn about creating, editing, and copying prompts.
Agent experience
Hallucination handling
Hallucinations in LLM-generated responses happen from time to time, so a Generative AI solution that’s trustworthy requires smart and efficient ways to handle them.
When returning answers to Conversation Assist, by default, KnowledgeAI takes advantage of our LLM Gateway’s ability to mark hallucinated URLs, phone numbers, and emails. This is done so that the client application—in this case, Conversation Assist—can understand where the hallucination is located in the response and handle it as required.
For its part, when Conversation Assist receives a recommended answer that contains a marked hallucination (URL, phone number, or email address), it automatically masks the hallucination and replaces it with a placeholder for the right info. These placeholders are visually highlighted for agents, so they can quickly see where to take action and fill in the right info.
Check out our animated example below: A hallucinated URL has been detected and masked. The agent sees the placeholder, enters the right URL, and sends the fixed response to the consumer.
To make quick work of filling in placeholders, make your contact info available as predefined content. This exposes the content on the Replies tab in the On-Demand Recommendations widget. The agent can copy the info with a single click and paste it where needed. We’ve illustrated this in our animation above.
Best practices
Train your agents
Train your agents on the difference between regular answer recommendations and enriched answer recommendations, the need to review the latter with care, and the reasons why. Similar important guidance is offered in the UI:
Your agents are able to edit enriched answers before sending them to consumers.
More best practices
See the general KnowledgeAI best practices on using our enrichment service.
Reporting
Use the Generative AI Dashboard in Conversational Cloud's Report Center to make data-driven decisions that improve the effectiveness of your Generative AI solution.
The dashboard helps you answer these important questions:
- How is the performance of Generative AI in my solution?
- How much is Generative AI helping my agents and bots?
The dashboard draws conversational data from all channels across Voice and Messaging, producing actionable insights that can drive business growth and improve consumer engagement.
Access Report Center by clicking Optimize > Manage on the left-hand navigation bar.
Limitations
Answer recommendations that are enriched via Generative AI can be plain answers, or they can be rich answers that contain an image and links (see an example).
Rich answers that are also enriched via Generative AI are supported. However, be aware that sometimes the generated answer from the LLM might not perfectly align with the image/links associated with the highest-scoring article, which are what are used.
Rich content only appears in an enriched answer when the generated answer is based on an article that has specified content links: content URL, audio URL, image URL, or video URL.
FAQs
What LLM is used?
To learn which LLM is used by default, open the prompt in the Prompt Library, and check the prompt's Advanced settings.
I'm offering bot recommendations to my agents, and I want those bots to send answers that are enriched via Generative AI. How do I turn this on?
This configuration is done at the interaction level in the bot, so you do this in LivePerson Conversation Builder, not in Conversation Assist. Learn about automating enriched answers.
Is there any change to how answer recommendations are presented to agents?
Yes. For a consistent agent experience, in the Agent Workspace you can always find enriched answers offered first, followed by answers that aren’t enriched, and bots listed last. Within each grouping, the recommendations are then ordered by their confidence scores.
The confidence score shown for the enriched answer recommendation is the confidence score of the highest-scoring article that was retrieved from the knowledge base.
Do hallucinations affect the confidence scores of recommended answers?
No. The answer, i.e., the article, is matched to the consumer’s query and given a confidence score for that match before the answer is enriched by the LLM service. (Learn about KnowledgeAI’s search flow.)
Enrichment of the answer via Generative AI doesn’t affect the assigned confidence score for the match. Similarly, hallucinations detected in the enriched answer don’t affect the score either.
More FAQs
See the general KnowledgeAI FAQs on our enrichment service.
Related articles
- Enriched Answers via Generative AI (KnowledgeAI)
- Prompt Library Overview
- Automate Enriched Answers via Generative AI (Conversation Builder)
- Trustworthy Generative AI for the Enterprise
- Bring Your Own LLM