TransMIXR

The future of media experiences is still to be written, and the maturity of eXtended Reality (XR) and Artificial Intelligence (AI) technologies provides a unique window of opportunity for the European Creative and Cultural Sector (CCS) to reimagine digital co-creation, interaction and engagement possibilities. TransMIXR, a consortium of eight representatives from the CCS and twelve leading industrial and academic partners, combines the necessary interdisciplinary skillsets and domain expertise to create a range of human-centric tools for remote content production and consumption via social virtual reality. The project’s TransMIXR platform will provide (i) a distributed XR Creation Environment that supports remote collaboration practices, and (ii) XR Media Experience Environment for the delivery and consumption of highly evocative and highly-social immersive media experiences. The ground-breaking AI techniques for the understanding and processing of complex media content will enable the reuse of heterogeneous assets across immersive content delivery platforms. Using the Living Labs methodology, TransMIXR will develop and evaluate four pilots that bring the vision of future media experiences to life in four CCS domains: (i) news media & broadcasting, (ii) performing arts, and (iii) cultural heritage. Additionally, the project will harness the creativity of the CCS and will forge interdisciplinary collaborations to demonstrate how immersive social experiences could be transferred to new application areas beyond the CCS. The results of the project will contribute to the Media and Audiovisual Action Plan from the European Commission, in particular boosting the adoption of XR technologies, opening new business models opportunities in new application areas and markets, and gaining worldwide leadership in XR technologies while being deeply grounded in European values such as veracity, diversity, connectedness and universality.

Our team was tasked with: 1) Volumetric studio implementation for volumetric capture of humans from multiple RGB-D sensors, 2) Real-time human reconstruction algorithms based on multi-view RGB-D data, 3) Streaming of real-time reconstructed data in Unity3D.

Consortium

Technological University of the Shannon: Midlands Midwest
STICHTING NEDERLANDSE WETENSCHAPPELIJK ONDERZOEK INSTITUTEN
MODUL TECHNOLOGY GMBH
THE PROVOST, FELLOWS, FOUNDATION SCHOLARS & THE OTHER MEMBERS OF BOARD, OF THE COLLEGE OF THE HOLY & UNDIVIDED TRINITY OF QUEEN ELIZABETH NEAR DUBLIN
ETHNIKO KENTRO EREVNAS KAI TECHNOLOGIKIS ANAPTYXIS
VRIJE UNIVERSITEIT BRUSSEL
WEBLYZARD TECHNOLOGY GMBH
IMMERSION
INTEL DEUTSCHLAND GMBH
CREATIVE SATOR E STUDIO
TRUE COMMUNICATION TECHNOLOGIES LIMITED
RADIOTELEVIZIJA SLOVENIJA JAVNI ZAVOD LJUBLJANA
AGENCE FRANCE PRESSE
STICHTING NEDERLANDS INSTITUUT VOORBEELD EN GELUID
BALTIC FILM & CREATIVE TECH CLUSTER
KHORA APS
EBU-UER
SPARKNEWS
FACHHOCHSCHULE ZENTRALSCHWEIZ – HOCHSCHULE LUZERN