Skip to main content
Skip table of contents

Using a Custom AI

It is possible to use a custom AI instead of one of the options provided by Rapport. Input speech recognition will still be handled by Rapport, in addition to the animation and audio playback.

  • Select Idle project type when setting up the project on the Rapport site

  • In your Unreal project, bind to the On Audio Input Detected event. This event will provide the input speech recognised by the STT (speech-to-text) system

image-20250623-141130.png
  • When STT is received via the event, it should be passed to your custom AI or chatbot as input

image-20250623-143915.png
  • Once the input text has been processed by your AI or chatbot and you have the output text to be spoken by the character, use the Request Character Speech function on the Rapport Player component. This will send the requested speech to Rapport which will return the corresponding audio and animation

image-20250623-135750.png
  • To stop the character from speaking at any point and clear requested audio, use Stop Character Speech on the Rapport Player component

image-20250623-144621.png

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.