Abstract

This thesis explores the integration of advanced AI technologies within the Unity game development framework to create an interactive AI avatar for serious gaming applications. By leveraging OpenAI's Whisper model for speech-to-text conversion, the ChatGPT API for natural language processing, and Pipper-TTS for realistic voice synthesis, the project aims to enhance user engagement and interaction in serious games. The motivation stems from the limitations of current AI avatars in real-time interaction and context-aware communication. The primary objective is to develop a Unity module that facilitates lifelike interactions with AI avatars, addressing challenges such as latency, accuracy, and naturalness in dialogues. This integration promises to revolutionize user experiences by providing more responsive and realistic AI-driven characters, significantly contributing to the field of interactive technology. The project also examines the roles and interactions of players and developers within the AI-enhanced application, highlighting the technical and user experience improvements achieved through this AI integration.