TransMIXR

TransMIXR Project

CORDIS Reference	Start date	End date	Coordinator
https://cordis.europa.eu/project/id/101070109	01/10/2022	30/09/2025	Technological University of the Shannon: Midlands Midwest

Project description

The advancement of extended reality (XR) and artificial intelligence (AI) has given the European creative and cultural sector (CCS) the opportunity to revolutionise digital co-creation, interaction and engagement. The EU-funded TRANSMIXR project will develop human-centred tools for collaborative co-creation and consumption of multi-modal immersive media through social XR. Using the Living Labs methodology, the project will bring together the necessary interdisciplinary skills and domain expertise to design and develop such human-centric tools and immersive media experiences. TRANSMIXR will pilot the technology in news media and broadcasting, performing arts and cultural heritage. It will also establish collaborations to demonstrate the transferability of these experiences to new domains outside the news media, arts and cultural sectors.

Project outputs

Publications

Domain	Type of output	Title	DOI URL
AI, Machine Learning & Data Science	Conference proceedings	Enhancing User Control in AI-Based Video Summarization for Social Media	https://doi.org/10.1007/978-981-96-2074-6_12
AI, Machine Learning & Data Science	Conference proceedings	An Experimental Study on Generating Plausible Textual Explanations for Video Summarization	https://doi.org/10.5281/ZENODO.17650009
AI, Machine Learning & Data Science	Peer reviewed articles	ACM Transactions on Multimedia Computing, Communications and Applications	https://doi.org/10.5281/ZENODO.13343545
Audio, Speech & NLP	Conference proceedings	A Comparison of Gender Differences and Performance Metrics in a VR-Based Auditory	https://doi.org/10.5281/ZENODO.13347685
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Gaussian Splatting vs. Classical Photogrammetry: A Comparison for Virtual Backdrops	https://doi.org/10.1109/QOMEX65720.2025.11219987
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Enhancing Immersive Experiences through 3D Point Cloud Analysis: A Novel Framework for Applying 2D Visual Saliency Models to 3D Point Clouds	https://doi.org/10.1109/QOMEX61742.2024.10598254
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Exploiting LMM-based knowledge for image classification tasks	https://doi.org/10.48550/ARXIV.2406.03071
Computer Vision, 3D Modeling & Rendering	Conference proceedings	TSalV360: A Method and Dataset for Text-driven Saliency Detection in 360-Degrees Videos	https://doi.org/10.5281/ZENODO.17649129
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Disturbing Image Detection Using LMM-Elicited Emotion Embeddings	https://doi.org/10.48550/ARXIV.2406.12668
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Video Shot Discovery Through Text2Video Embeddings in a News Analytics Dashboard	https://doi.org/10.1109/CBMI62980.2024.10859251
Computer Vision, 3D Modeling & Rendering	Conference proceedings	UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications	https://doi.org/10.1145/3746027.3758263
Computer Vision, 3D Modeling & Rendering	Conference proceedings	MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025	https://doi.org/10.5281/ZENODO.18346563
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Subjective Qality Evaluation of Point Clouds using Remote Testing	https://doi.org/10.1145/3607546.3616803
Computer Vision, 3D Modeling & Rendering	Conference proceedings	VidCtx: Context-aware Video Question Answering with Image Models	https://doi.org/10.5281/ZENODO.17198741
Computer Vision, 3D Modeling & Rendering	Conference proceedings	VERGE in VBS 2026	https://doi.org/10.5281/ZENODO.18268841
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Online Anchor-based Training for Image Classification Tasks	https://doi.org/10.1109/ICIP51287.2024.10648148
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Auto-summarization of Human Volumetric Videos	https://doi.org/10.1145/3672406.3672416
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Visual-Saliency Guided Multi-modal Learning for No Reference Point Cloud Quality Assessment	https://doi.org/10.1145/3689093.3689183
Computer Vision, 3D Modeling & Rendering	Conference proceedings	An LLM Framework for Long-Form Video Retrieval and Audio-Visual Question Answering Using Qwen2/2.5	https://doi.org/10.1109/CVPRW67362.2025.00358
Computer Vision, 3D Modeling & Rendering	Conference proceedings	A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods	https://doi.org/10.1145/3672406.3672417
Computer Vision, 3D Modeling & Rendering	Conference proceedings	LMM-Regularized CLIP Embeddings for Image Classification	https://doi.org/10.48550/ARXIV.2412.11663
Computer Vision, 3D Modeling & Rendering	Conference proceedings	Prototype Anchoring for Image Classification Tasks	https://doi.org/10.23919/EUSIPCO63174.2024.10715272
Computer Vision, 3D Modeling & Rendering	Other	TSV360: A dataset for training and objective evaluation of text-driven 360-degrees video saliency detection methods	https://doi.org/10.5281/ZENODO.16991178
Computer Vision, 3D Modeling & Rendering	Other	Gaussian Splatting vs. Classical Photogrammetry: Input Data	https://doi.org/10.5281/ZENODO.17185795
Computer Vision, 3D Modeling & Rendering	Other	Gaussian Splatting vs. Classical Photogrammetry: 3D Models	https://doi.org/10.5281/ZENODO.17143763
Computer Vision, 3D Modeling & Rendering	Other	Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video	https://doi.org/10.3390/arts12040156
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	PointPCA+: A full-reference Point Cloud Quality Assessment metric with PCA-based features	https://doi.org/10.1016/J.IMAGE.2025.117262
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors	https://doi.org/10.1186/S13640-024-00626-3
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	Subjective and Objective Quality Assessment for Dynamic Point Cloud with Visual Attention in 6 DoF	https://doi.org/10.1145/3731759
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	Delay threshold for social interaction in volumetric eXtended Reality communication	https://doi.org/10.1145/3651164
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	Comparison of Visual Saliency for Dynamic Point Clouds: Task-free vs. Task-dependent	https://doi.org/10.1109/TVCG.2025.3549863
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	A QoE and Visual Attention Evaluation for 360° videos with non-spatial and spatial audio	https://doi.org/10.1145/3650208
Computer Vision, 3D Modeling & Rendering	Peer reviewed articles	UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications	https://doi.org/10.1145/3746027.3758263
Education, Training & Serious Games	Peer reviewed articles	The potential of extended reality in Rural Education’s future–perspectives from rural educators. Education and Information Technologies	https://doi.org/10.1007/S10639-023-12169-7
Education, Training & Serious Games	Peer reviewed articles	Utilizing virtual reality to assist social competence education and social support for children from under-represented backgrounds	https://doi.org/10.1016/J.COMPEDU.2023.104815
Ethics, Society, Arts & Culture	Conference proceedings	Social Density and its Impact on Behaviour in Virtual Environments	https://doi.org/10.1145/3746269.3760421
Ethics, Society, Arts & Culture	Conference proceedings	Ethical Considerations in the Production and Consumption of Music in the Metaverse	https://doi.org/10.1109/IS262782.2024.10704197
Ethics, Society, Arts & Culture	Conference proceedings	Finding Video Shots for Immersive Journalism Through Text-to-Video Search	https://doi.org/10.1109/CBMI62980.2024.10859220
Ethics, Society, Arts & Culture	Conference proceedings	VR Planica: Gaussian Splatting Workflows for Immersive Storytelling	https://doi.org/10.5753/IMXW.2025.8141
Ethics, Society, Arts & Culture	Conference proceedings	Exploring engagement dynamics between journalists and news consumers in Social XR	https://doi.org/10.1145/3672406.3672420
Ethics, Society, Arts & Culture	Conference proceedings	Communication Challenges between Clients and Producers of Immersive Media Applications: can Social XR help?	https://doi.org/10.1145/3639701.3656307
Ethics, Society, Arts & Culture	Other	Physiological Synchrony: A Novel Approach to Evaluating User Quality of Experience in Collaborative Distributed Virtual Reality Environments	https://doi.org/10.5281/zenodo.8224881
Ethics, Society, Arts & Culture	Peer reviewed articles	Designing and Evaluating a VR Lobby for a socially enriching remote Opera watching experience	https://doi.org/10.1109/TVCG.2024.3372081
Ethics, Society, Arts & Culture	Peer reviewed articles	Cognitive Representations and Personal Experiences of COVID-19 Using Social Virtual Reality	https://doi.org/10.1162/PRES_A_00429
Ethics, Society, Arts & Culture	Peer reviewed articles	Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage	https://doi.org/10.3390/HERITAGE8070238
Ethics, Society, Arts & Culture	Peer reviewed articles	Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage	https://doi.org/10.3390/HERITAGE8070238
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis	https://doi.org/10.5281/ZENODO.13343703
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Exploring the impact of volumetric graphics on the engagement of broadcast media professionals	https://doi.org/10.21203/RS.3.RS-3994643/V1
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis	https://doi.org/10.5281/ZENODO.13343703
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Exploring user feedback in VR: the added value of qualitative evaluation methods	https://doi.org/10.5753/IMXW.2025.4030
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Extending 3-DoF Metrics to Model User Behaviour Similarity in 6-DoF Immersive Applications	https://doi.org/10.1145/3587819.3590976
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR	https://doi.org/10.1109/QOMEX65720.2025.11219992
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Tangible Authoring of Embedded-Object Visualizations in Mixed Reality	https://doi.org/10.1145/3678698.3687187
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Emerging Telepresence Technologies for Hybrid Meetings: Experiences and Lessons Learned from an Interactive Workshop	https://doi.org/10.1145/3712677.3720464
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	ComPEQ-MR: Compressed Point Cloud Dataset with Eye Tracking and Quality Assessment in Mixed Reality	https://doi.org/10.1145/3625468.3652182
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Correlation between Entropy and Prediction Error in VR Head Motion Trajectories	https://doi.org/10.1145/3607546.3616805
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	A Volumetric Video Application to Enhance Museum Experiences	https://doi.org/10.1145/3641825.3689695
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Open-Sourcing VR2Gather: A Collaborative Social VR System for Adaptive Multi-Party Real Time Communication	https://doi.org/10.1145/3664647.3685515
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Directed Views in Virtual Reality: A Semantic Approach to Volumetric Video Storytelling	https://doi.org/10.1145/3675231.3678872
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Back to the Virtual Future: Presence in Cinematic Virtual Reality	https://doi.org/10.1145/3672406.3672418
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Exploring entropy-based solutions for trajectory prediction in virtual reality	https://doi.org/10.1145/3712677.3720460
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	IXR '25: 3rd International Workshop on Interactive eXtended Reality	https://doi.org/10.1145/3746027.3762385
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla Hubs	https://doi.org/10.1145/3652212.3652225
Extended Reality (VR/AR/MR) & HCI	Conference proceedings	Spatial Media Controller: Exploring the Potential of Augmented Reality, Virtual Reality, Volumetric Capture and 360 Videos for News Broadcasting	https://doi.org/10.1145/3706370.3727868
Extended Reality (VR/AR/MR) & HCI	Other	TangibleMRCreate: Intuitive Authoring of Mixed Reality Content	https://doi.org/10.2312/EGVE.20231339
Extended Reality (VR/AR/MR) & HCI	Other	RCQoEA-360VR: Real-time Continuous QoE Scores for HMD-based 360° VR Dataset	https://doi.org/10.1145/3746027.3758259
Extended Reality (VR/AR/MR) & HCI	Other	Avatar Customization, Personality, and the Perception of Work Group Inclusion in Immersive Virtual Reality	https://doi.org/10.1145/3584931.3606992
Healthcare, Medicine & Accessibility	Conference proceedings	QoE Evaluation of Remote Physiotherapy in Volumetric Video and Video-Based Real-Time Communication	https://doi.org/10.1109/ICME59968.2025.11209852
Healthcare, Medicine & Accessibility	Peer reviewed articles	Predicting Quality of Multimedia Experience Using Electrocardiogram and Respiration Signals	https://doi.org/10.1109/ACCESS.2024.3420103
Networks, Cloud & Telecommunications (5G/6G)	Conference proceedings	VVGLTF: Efficient Streaming of Volumetric Video with GLTF	https://doi.org/10.5281/ZENODO.17651190
Networks, Cloud & Telecommunications (5G/6G)	Peer reviewed articles	VVGLTF: Efficient Streaming of Volumetric Video with GLTF	https://doi.org/10.5594/JMI.2025/GLNG7938

Technological assets

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset	Dataset	https://doi.org/10.1145/3746027.3758263	Point cloud dataset optimized for volumetric video applications.
ComPEQ-MR	Dataset	https://doi.org/10.1145/3625468.3652182	A compressed point cloud dataset featuring eye tracking and quality assessment in mixed reality.
TSalV360: Text-driven Saliency Detection	Dataset / Method	https://doi.org/10.5281/ZENODO.17649129	Method and dataset tailored for saliency detection within 360-degree videos.
VR2Gather	Open-Source System	https://doi.org/10.1145/3664647.3685515	A collaborative social VR system open-sourced for adaptive multi-party real-time communication.
TangibleMRCreate	Software Tool	https://doi.org/10.2312/EGVE.20231339	An intuitive authoring tool created to facilitate the development of mixed reality content.