Using a Custom AI

It is possible to use a custom AI instead of one of the options provided by Rapport. Input speech recognition will still be handled by Rapport, in addition to the animation and audio playback.

• Select Idle project type when setting up the project on the Rapport site

• In your Unreal project, bind to the On Audio Input Detected event. This event will provide the input speech recognised by the STT (speech-to-text) system

• When STT is received via the event, it should be passed to your custom AI or chatbot as input

• Once the input text has been processed by your AI or chatbot and you have the output text to be spoken by the character, use the Request Character Speech function on the Rapport Player component. This will send the requested speech to Rapport which will return the corresponding audio and animation

• To stop the character from speaking at any point and clear requested audio, use Stop Character Speech on the Rapport Player component