Rapport Unity Viewer Plugin Overview
What is the Rapport Unity Viewer?
The Rapport Unity Viewer Plugin is a Unity plugin that connects your Rapport project and drives character performances.
Through a direct connection between your Rapport project and Unity Engine, the plugin enables real-time character animation and communication.
The plugin provides a simple, component-based workflow that allows developers to:
Connect to a Rapport session.
Stream live microphone input from the user.
Receive and apply real-time facial animation and audio to a character rig.
Manage a Rapport session's lifecycle through a C# API.
The plugin also includes a samples package with example scenes and scripts that demonstrate how to set up and use the plugin's features.
How It Works:
Audio can be input via a microphone, sound wave asset, etc. and this will then be sent to Rapport.
In response, Rapport returns synchronized speech and animation data.
This data drives your character’s movements and facial expressions, ensuring that the character’s speech and performance match the spoken words.
By using the Rapport Unity Plugin, you can create lifelike, interactive digital characters for games, simulations, and virtual experiences.