Evaluation framework for assessing AI/ML models applied to media processing in 5G network contexts.
The tools provide standardised benchmarks and datasets for evaluating machine learning models for media quality enhancement, adaptive bitrate (ABR) optimisation, and traffic classification, aligned with the AI/ML work items of 3GPP working group SA4 (the group responsible for codec and media work). It is intended for researchers and engineers contributing to the standardisation of AI-native media delivery and informing 5G-MAG's 6G research direction. For acronyms used here, see the Glossary.
The specifications below are listed as background context, not as a prerequisite reading list.
Specifications referenced: 3GPP TR 26.927 (Study on AI and ML in 5G media services) and its companion evaluation report TR 26.847, both Release 19, plus TR 22.874 (AI/ML in 5G scenarios).
The reference tooling is currently private and under testing. Request early access.
Contributors
Project Overview
The slide deck below introduces the AI/ML Evaluation Framework: what it evaluates (media quality enhancement, adaptive bitrate optimisation, and AI traffic classification), the benchmarks and datasets it provides, and how it relates to the shared 6G Testbed used for the hands-on traffic characterisation work.
Download the slide deck of this ProjectGo deeper
| Area | Details |
|---|---|
| Scope | Focus areas, repositories, and relationship to standards: Scope |
| Technical documentation | How 3GPP's network-side and UE-side AI/ML tracks fit together: AI/ML in 5G Media on the Tech portal |
| Standards | AI/ML in 5G media standardisation: AI/ML on the Standards portal |
| Related project | AI traffic classification testbed: AI Traffic Characterization |
Developer Exchange
No AI/ML Evaluation Framework-specific videos are curated here yet. In the meantime, here's what's recent from the wider Developer Exchange:
Connecting MBSTF to the MBS System - Developer Exchange
Connecting MBSTF to the MBS System - Developer Exchange
Introducing the Avatar Real-Time Communication Project - Developer Exchange
Introducing the Avatar Real-Time Communication Project - Developer Exchange
5G Media Streaming: Latest Additions - Developer Exchange
5G Media Streaming: Latest Additions - Developer Exchange
Community Stats
Last Synced: 2026-08-14 00:49 UTC
| Repository | Stars | Forks | Views (Total) | Clones (Total) | Activity |
|---|---|---|---|---|---|
| rt-ai-ml-evaluation-framework | 1 | 2 | 125 | 0 | Stable |