Conversational Digital Avatars

Conversational Digital Avatars

Conversational Digital Avatars

n≠1

n≠1

n≠1 is a real-time AI avatar system combining conversational AI, synthetic voice and high-fidelity 3D characters. It enables responsive, context-aware interaction with digital representations across different interfaces and environments.

I designed and built the conversational architecture and real-time interaction system behind the digital avatar experience. My work included dialogue and context logic, conversational memory, speech processing, behavioural control, real-time avatar responses and the integration of these components into an embodied spatial experience.

Year

Year

2024

2024

2024

Project Type

Project Type

/

/

/

Digital Avatars

Digital Avatars

Digital Avatars

/

/

/

Human-AI-Interaction

Human-AI-Interaction

Human-AI-Interaction

/

/

/

AI Systems

AI Systems

AI Systems

Technical Scope

Technical Scope

/ Conversational AI / contextual memory / speech processing / real-time avatar behaviour / multimodal interaction

/ Conversational AI / contextual memory / speech processing / real-time avatar behaviour / multimodal interaction

/ Conversational AI / contextual memory / speech processing / real-time avatar behaviour / multimodal interaction

System Architecture

System Architecture

/ Dialogue system / context & memory layer / speech pipeline / behavioural control layer / real-time animation / spatial interaction

/ Dialogue system / context & memory layer / speech pipeline / behavioural control layer / real-time animation / spatial interaction

/ Dialogue system / context & memory layer / speech pipeline / behavioural control layer / real-time animation / spatial interaction

Format

Format

Interactive VR Experience

Interactive VR Experience

Interactive VR Experience

Role

Role

Design Engineer

Design Engineer

Design Engineer

n≠1 Conversational Digital Avatars by Chantal Pisarzowski

About the project

About the project

n≠1

Conversational Digital Avatar System

From prototype to internationally recognised project.

From prototype to internationally recognised project.

Real-time conversational digital avatars combining generative AI, voice and high-fidelity 3D characters.

Real-time conversational digital avatars combining generative AI, voice and high-fidelity 3D characters.

n≠1 Conversational Digital Avatars by Chantal Pisarzowski VR Application
n≠1 Conversational Digital Avatars by Chantal Pisarzowski VR Application
Dark gradiend background
Dark gradiend background

Cooperation Partners

Partner

International recognition

Lumen Prize Finalist '24

Featured in

Next-gen AI Digital Avatar System.

16+ exhibitions & showcases

Ars Electronica, Berlin Design Week, IVA and more.

Invited talks

Alexander von Humboldt Institute for Internet and Society, Max Planck Institute for Human Development and more.

Research collaborations

Ongoing work around digital avatars and human–AI interaction with ETH Zurich and DFKI.

How you interact

How you interact

n≠1 enables real-time conversation with a digital representation of a real person.

The user speaks directly to the avatar in natural language. The system generates context-based responses and translates them into synthetic speech, facial animation and gaze behaviour in real time.

01

Parallaxe AI-mediated dialogue system by Chantal Pisarzowski

Open-ended conversation

02

Parallaxe AI-mediated dialogue system by Chantal Pisarzowski

Identity-grounded responses

03

Parallaxe AI-mediated dialogue system by Chantal Pisarzowski

Voice and facial output

04

Parallaxe AI-mediated dialogue system by Chantal Pisarzowski

Real-time avatar behaviour

Watch showreel

(2024-26©)

Watch showreel

(2024-26©)

Parallaxe AI-mediated dialogue system by Chantal Pisarzowski

System architecture

n≠1 combines speech recognition, conversational AI, person-specific context, synthetic voice and real-time character animation in one modular avatar system. The architecture turns static digital representations into responsive conversational interfaces that can be adapted to different identities, datasets and deployment formats.

Each layer can be replaced or extended independently – from the language model and knowledge base to voice, animation and the final interface.

System architecture

n≠1 combines speech recognition, conversational AI, person-specific context, synthetic voice and real-time character animation in one modular avatar system. The architecture turns static digital representations into responsive conversational interfaces that can be adapted to different identities, datasets and deployment formats.

Each layer can be replaced or extended independently – from the language model and knowledge base to voice, animation and the final interface.

Input processingConversation engineResponse renderingUser speechSpeech-to-textTranscriptionEmotion & prosodyVoice cuesConversational AIContext · dialogue · responseKnowledge contextSource material · memorycontext retrievalText-to-speechVoice synthesisFacial animationLip sync · expressionAudio playbackGenerated speechAvatarresponseContinuous behaviourIdle animation · gaze alignment · spatial behaviour

Where it applies

Where it applies

Conversational avatars can be adapted to different people, knowledge bases and interaction contexts.

The underlying system is not tied to a single use case. By changing the source material, character model and interaction setup, the same architecture can support different applications.

Cultural heritage & historical figures

Archival material, interviews and historical records can be translated into interactive digital representations that visitors can question directly.

Cultural heritage & historical figures

Archival material, interviews and historical records can be translated into interactive digital representations that visitors can question directly.

Training & education

Responsive avatars can simulate realistic conversation partners for role-play, communication training and scenario-based learning.

Training & education

Responsive avatars can simulate realistic conversation partners for role-play, communication training and scenario-based learning.

Virtual characters & guides

In digital products, exhibitions and spatial environments, avatars can act as interactive characters, hosts or guides that respond in real time.

Virtual characters & guides

In digital products, exhibitions and spatial environments, avatars can act as interactive characters, hosts or guides that respond in real time.

What it investigates

What it investigates

Digital avatars raise fundamental questions around identity, consent, privacy and the psychological effects of representing real people through AI.

n≠1 uses bereavement as a high-stakes research context to examine these risks. The project looks at who can create and control a digital representation, how personal data and source material are handled, how generated behaviour is distinguished from authentic records, and how continued interaction may affect memory, attachment and experiences of loss.

What it led to

What it led to

The project grew into an ongoing research direction around digital avatars, grief tech and posthumous digital identity.

The work gained international visibility through exhibitions, invited talks and public discussions. It received recognition including a Lumen Prize finalist nomination and led to further research collaborations around digital humans, interactive avatars and human–AI interaction with institutions including ETH Zurich and the German Research Center for Artificial Intelligence (DFKI).

Cooperations with

Cooperations with

ETH Zurich

German Research Center for Artificial Intelligence (DFKI)

Max Planck Institute for Human Development

Press & Media

Press & Media

Interview

Bayerischer Rundfunk

Interview on AI ethics

Interview

Interview ZDF Aspekte

Virtual Love - Can AI love?

Interview

Interview with FAZ

“AI & Death: Is Grieftech useful?”

Interview

HTW Campus Stories

Interview “Faces of HTW”

Interview

Bayerischer Rundfunk

Interview on AI ethics

Interview

Interview ZDF Aspekte

Virtual Love - Can AI love?

Interview

Interview with FAZ

“AI & Death: Is Grieftech useful?”

Interview

HTW Campus Stories

Interview “Faces of HTW”

Interview

Bayerischer Rundfunk

Interview on AI ethics

Interview

Interview ZDF Aspekte

Virtual Love - Can AI love?

Interview

Interview with FAZ

“AI & Death: Is Grieftech useful?”

Interview

HTW Campus Stories

Interview “Faces of HTW”