Skip to main content
XR/3D Scenes with MPEG-I Scene Description

Immersive and 3D Media message

The goal of this tutorial is to show how 3D and AR assets can be shared like media attachments (for example through a Multimedia Messaging Service (MMS) message or a third-party messaging app) and then opened and rendered in the XR player. A "3GPP conforming container" here means the asset is packaged so that it can be carried by 3GPP messaging services.

Each use case below reuses the same reference assets from the rt-xr-content repository. To try any of them, build and configure the player once by following the Android build instructions, then load the listed asset.

VR/XR/3D Scene​

Use case 1: Sharing a 3D asset as a 3GPP conforming MMS message​

Example: 3GPP shares the 3GPP Emmy Statue as 3GPP conforming messaging MMS to all members.

Reference asset:

Use case 2: Sharing a 3D asset through a third-party application using 3GPP conforming containers​

Example: A house rental agency offers rooms whose assets you can walk through. They share the assets through WhatsApp using 3GPP conforming containers.

Reference asset (provided with the relevant glTF extensions):

Use case 3: Extension of use case 2 to add images inside the 3D asset​

Example: An extension of use case 2 provides the ability to add your family pictures to the wall.

Status: not yet implemented. This use case needs support for manipulating a 3D node (MPEG_scene_interactivity) together with anchoring constraints (MPEG_anchor), tracked in:

AR Scenes​

Use case 4: Extension of use case 1 including information to anchor the model​

Example: 3GPP shares the 3GPP Emmy Statue as 3GPP conforming messaging MMS to all members, including information to put it on your living desk.

Reference assets (provided with the relevant glTF extensions to signal AR anchoring):

Use case 5: Extension of use case 2 including information to manipulate a model with anchoring constraints​

Example: Ikea offers furniture on their webpage that you can request. They share the assets through Signal using 3GPP conforming containers. You can place the asset on your living room's floor and check how it fits.

Status: not yet implemented. Like use case 3, this needs combined interactivity and anchoring support; it differs in that the model is manipulated (placed and repositioned) under anchoring constraints rather than only having images added. Tracked in the same issue:

Learn more​