Metahumans and others: Deploying Realistic Characters with Rapport

Rapport supports a wide range of realistic digital characters—not just Unreal’s MetaHumans, but also formats like AvatarOS and 2DNAC.

This guide outlines two powerful deployment pathways depending on your level of customization and control. The examples below focus on MetaHumans, but the same principles apply to other character types.

Option 1: Pre-Packaged MetaHumans via Cloud Rendering (GStreamer)

Rapport provides a cloud-hosted pixel streaming solution using GStreamer, allowing users to deploy MetaHumans directly in the browser with minimal setup.

TL;DR: Project Setup for Web Page & Widget Apps

1. Create a New Project in Rapport Studio

   • Choose Web Page or Web Widget as the application type

   • Select a MetaHuman from the public or custom library

2. Configure Core Settings

   • Choose language, voice (TTS), and AI model

3. Cloud Rendering

   • The MetaHuman is embedded in a pre-packaged Unreal scene (clothing, background, camera, resolution)

   • Streamed to the browser using GStreamer

4. Deploy

   • Use Rapport Web Viewer or embed the widget into your site

Note: These scenes are fixed. Users cannot modify the character, environment, or layout.

Option 2: Custom Scenes via Rapport Unreal Plugin

The Rapport Unreal Plugin (RUV) allows developers to integrate Rapport directly into Unreal Engine, enabling full creative control over the scene and character.

Key Features

• Scene & Character Customization

  • Modify or create MetaHumans

  • Customize environments, lighting, and camera

• Live Rapport Integration

  • Connects directly to Rapport’s backend for real-time AI interaction

• Pixel Streaming Support

  • Includes Audio Input Feature and Pixel Streaming Audio Component

  • Ensures speech input works even when using third-party streaming (e.g., Arcware)

• Secure Deployment

  • Uses Deploy Tokens to link Unreal projects to Rapport configurations

Workflow Summary

1. Create a project in Rapport Studio → Select Unreal Plugin as the application type

2. Configure character, voice, and AI

3. Generate a Deploy Token

4. Connect the plugin in Unreal → Begin real-time interaction

Summary Table

*Note: Additional costs may apply for the use of a 3rd party service