What is Rapport?

Rapport is a cloud-based platform for creating interactive experiences with AI-driven digital characters. It empowers businesses to design, configure, and deploy engaging virtual personalities for use in customer service, training, entertainment, and more.

Rapport is developed by the team behind Speech Graphics' industry-leading audio-driven facial animation technology, used by major AAA game publishers. The platform utilizes detailed muscle maps for highly accurate lip-sync, ensuring natural and expressive character interactions across various art styles and languages.

How Does Rapport Work?

This guide covers: Creating projects in Rapport Studio and integrating them into applications via Rapport Session Runners using Rapport Web Viewer, Rapport Unreal Engine Plugin, and future integrations.

Rapport operates through a sophisticated cloud-based framework that processes voice and text interactions to deliver seamless, real-time digital character responses. The platform consists of two key components:

• Rapport Studio – A web-based interface where users create and configure interactive projects, accessible at Rapport Studio

• Rapport Session Runners – Cloud-based (or on-premise) servers that handle live user sessions, executing character interactions.

Backend Processing

Rapport's backend services manage the complex processing required for realistic AI-driven interactions. These services include:

• Speech recognition to interpret user voice inputs.

• Text-to-speech conversion for character responses.

• Voice trait analysis for natural engagement.

• Language translation for multilingual support.

• High-fidelity animation generation for realistic digital character movements.

Frontend Integration

The frontend component of Rapport integrates directly into websites or applications, securely transmitting voice and text inputs to the backend for processing. In return, it receives and renders character responses, including:

• Real-time voice output.

• Synchronized lip-sync and facial animations.

• Context-aware, natural interactions.

With ultra-low latency streaming and encrypted communication, Rapport delivers a responsive and secure user experience.

Main Components of Rapport

1. Rapport Studio

Rapport Studio is the cloud-based interface where users configure their projects.

Key Features:

Project Creation & Configuration

• Connect to third-party services (e.g., Speech-to-Text, LLM, Text-to-Speech).

• Set up audio-visual elements (e.g., 3D character models, character voices).

• Define conversation logic (e.g., LLM prompts, conversational flows).

Project Deployment & Sharing

• Host demos on Rapport's servers.

• Embed web components into external websites. (Rapport Web Viewer)

• Deploy via plugins for desktop or mobile apps (e.g., Unreal Engine, Unity).

Asset Management

• Manage character models, audio files, and other required assets.

User Access & Security

• Manage user roles and permissions.

Analytics & Billing

• View session statistics and usage metrics.

• Manage payment and billing settings.

2. Rapport Session Runners

Rapport Session Runners are servers responsible for handling live conversations between end users and digital characters. These servers can run in the cloud or (in the future) on-premise.

Key Features:

Real-time Interaction Processing

• Establish bidirectional connections between clients and the backend.

• Integrate with third-party AI services for speech and text processing.

• Render high-quality facial and body animations using in-house and external technologies.

Performance & Reliability

• Record and transmit session metrics to Rapport Studio for analysis.

• Implement load balancing and automatic scaling.

• Provide fallback options between third-party providers for increased reliability.

User Categories

1. Rapport Studio Users

These are businesses and developers who use Rapport Studio to create and configure projects. They can share their projects via:

• Web components embedded in external websites.

• Fully hosted demo pages on Rapport servers.

• Custom desktop or mobile applications using Rapport plugins.

2. End Users

End users are customers who interact with the digital characters powered by Rapport. They access Rapport Session Runners for real-time conversations.

Getting Started with Rapport

To integrate Rapport into your workflow, follow these two main steps:

1. Create and Configure a Project in Rapport Studio.

2. Integrate the Project into your application using Rapport Web Viewer or other deployment methods.

With Rapport, businesses can build immersive, AI-driven digital experiences that feel intuitive, responsive, and natural.