filename     : Wam24a.pdf
entry        : 
journal      : 
pages        : 1 - 2
year         : 2024
month        : 12
title        : Immersive Conversations with Digital Einstein: Linking a Physical System and AI
subtitle     :
author       : Rafael Wampfler
booktitle    : SIGGRAPH Asia 2024 Emerging Technologies
ISSN/ISBN    : 9798400704628
editor       : 
publisher    : Association for Computing Machinery
publ.place   :
language     : English
keywords     : Conversational Digital Characters, Digital Einstein, Animation, Speech Recognition, Speech Synthesis, Large Language Models
abstract     : We present Digital Einstein, an immersive platform that enables interactive conversations with a digital representation of Albert Einstein. The physical setup includes a screen, armchair, camera, speakers, microphone, and decorative elements. Utilizing advanced technologies such as natural language processing, machine learning, and dynamic rendering, the platform simulates realistic dialogs with Einstein on various topics about his life and research. The system features two versions: Version 1 uses a dialog tree, motion-captured animations, and pre-recorded speech for fluid, controllable interactions. In Version 2, users can choose between GPT-4o-based and Llama 3-based chatbots for more open and engaging conversations. Data-driven models synthesize Einstein’s voice and generate corresponding animations on the fly, while context-specific images are automatically generated to visually enrich the conversation. Digital Einstein offers a glimpse into the future of immersive, personalized dialog experiences with intelligent characters.