Overview
The goal of this project is to build a Proof-of-Concept in Unreal Engine 5 where a MetaHuman can hold a real-time conversation with the user. The user speaks through a microphone, the audio is converted into text using a Speech-to-Text system, processed by an AI chatbot (LLM), and then converted back into audio via Text-to-Speech. The MetaHuman will play this audio with proper lip-sync.
Additionally, the MetaHuman should be able to perform one simple in-world action based on an AI-generated intent, such as “pick up the ball.”
The PoC does not need to be production-ready, but it must demonstrate that the full technical loop works end-to-end.
Members
Manager: Malek chrifi alaoui