LivePerson’s Conversational Cloud includes a Large Language Model (LLM) Gateway that sits between our applications and the LLM service that is used for Generative AI.

A security diagram illustrating how brand LivePerson's LLM Gateway sits between our applications and the LLM service

The primary job of the LLM Gateway is to pass requests to the LLM service and to receive responses in return. In this role, the gateway performs some post-processing that is both vital and useful: