Skip to main content

Conversational Avatar Communication

Real-time conversational avatars, animated from user to user

Conversational Avatars with MPEG ARF, project cover

Avatar Communications covers real-time conversational avatar systems in 5G contexts, targeting the MPEG Avatar Representation Format (ARF) and its use for avatar-based communications. Avatars are synthesised digital representations of participants, animated in real time from audio and video input, enabling immersive video calls and virtual presence experiences.

5G-MAG's work looks at the tools needed to encode, render, and stream avatars over 5G networks: the avatar representation itself, its animation, and the media transport that carries it.

This project is based on technology developed by:

Opens your own assistant with your question typed in; Gemini needs you to paste it. Answers can be wrong, so check the links it gives. 5G-MAG does not receive your question.

The Problem It Solves

Before ARF, an avatar-based call needed the sender's capture/tracking system and the receiver's rendering engine to come from the same vendor's proprietary avatar format: there was no common way to describe the avatar asset itself or the animation stream driving it. ARF standardises both once: the base avatar (stored and exchanged as an ISOBMFF or Zip-based asset) and the animation stream (a sequence of compact Avatar Animation Units) are separate, interoperable formats, so a conforming client can load an avatar from one vendor and drive it with animation produced by a different vendor's tracking system, over an ordinary 5G call.

Latest updates and roadmap

Status on 4 November 2026

brought to study

  • Avatar calls phase 2
  • Body animation support in the avatar call client

on-going

  • Gaussian splatting avatars
  • Animation generation on Android XR
  • Base Avatar Repository
  • Android Avatar Call Client Application with enhanced UX

outcomes

  • Initial Avatar Call Client
  • Initial implementation of SWAP protocol
  • Avatar content for the call client

Edit or follow this roadmap on GitHub

Overview deck

The project at a glance

What it is, how it works, and where the Reference Tools stand, in one deck you can share.

Download the deck (Conversational Avatar Communication with MPEG ARF)

From idea to running code

Read it, check it against the standard, then run it.

1
Learn

Technology

How this technology works, and what it is good for.

2
Standards

Specifications

The specifications this technology is built on.

3
Build

Software Accelerator

The open-source software that implements it.

Repositories of This Project

The real, running software for this technology: what each repository is, what it implements, its latest release and where to find it.

Early Access Early Access: available to members first

3GPP SWAP Protocolrt-3gpp-swapEarly Access
no release yet
Avatar Callrt-avatar-callEarly Access
v0.10.1542026-10-16 · 4w ago
Avatar Unity Trackerrt-avatar-unity-trackerEarly Access
no release yet
Base Avatar Repositoryrt-avatar-barEarly Access
no release yet
Content for Avatar Callrt-avatar-contentEarly Access
v0.10.1542026-10-16 · 4w ago