How Rapport Works (At a Glance)
Rapport operates as two connected systems — a creative workspace for building and a real-time engine for delivery.
This split allows teams to collaborate efficiently while keeping live interactions fast, reliable, and scalable.
The Two Main Components
1. Rapport Studio (Browser)
A browser-based environment where creators design and configure characters with a live preview.
From Rapport Studio, you can:
Start from templates or build from scratch
Pick characters, AI models, languages, and voices
Define prompts, behaviour, and layout
Manage projects, assets, and workspaces
💡 Runs entirely in your browser — no installation required.
2. Session Runners (Cloud / On-Prem)
The Session Runners form the real-time engine that powers every live interaction.
They orchestrate communication between AI, voice, and animation services, ensuring each response feels immediate and natural.
Session Runners handle:
Streaming audio and data in real time
Connecting to AI, STT, TTS, and animation providers
Sending back synchronised voice and animation for rendering
Managing reliability and fallback in case of service interruption
Optimised for:
Low latency — fast, conversational response times
High concurrency — supports many users at once
Reliability — automatic recovery and error handling
Technology Stack Overview
Layer | Technology |
|---|---|
Frontend (User) | Web viewer, Unreal integration (Unity coming soon) |
Rapport Studio | Project editor & asset manager |
Session Runners | Real-time orchestration layer |
AI Services | OpenAI, Gemini, Groq, or custom LLMs |
STT / TTS Providers | Whisper, Google, Azure, AWS, Speechmatics, ElevenLabs |
Facial Animation | Powered by Speech Graphics’ expressive animation engine |
Cloud Infrastructure | Secure, load-balanced, and scalable |
Rapport integrates text, speech, animation, and emotion into a seamless, real-time performance — delivering high-quality character interaction across devices and environments.
Why This Split Works
Creators gain a clean, no-code workspace for designing and testing interactive characters.
Developers can extend or integrate Rapport into existing pipelines using SDKs and APIs.
End-users experience fast, expressive, and reliable interactions at scale.
This architecture makes Rapport flexible enough for solo creators, production teams, and enterprise-scale deployments alike.