SHARESPACE: Difference between revisions
No edit summary |
No edit summary |
||
| Line 8: | Line 8: | ||
=== Project description === | === Project description === | ||
Extended reality (XR) is an emerging technology with promising potential in many areas, but several limitations must be overcome to enrich the interactive experience for users. The EU-funded SHARESPACE project aims to establish a novel prototype for a socially interactive avatar and/or agent based on human sensorimotor communication. It will capture natural body movements, facial expressions and hand gestures to compile an array of sensorimotor primitives: these will aid the design of AI-based architecture of a fully mobile human rendering with customisable characteristics. SHARESPACE will validate the prototype in three real-life situations of shared hybrid spaces involving human and artificial agents in the fields of health, sport and art | Extended reality (XR) is an emerging technology with promising potential in many areas, but several limitations must be overcome to enrich the interactive experience for users. The EU-funded SHARESPACE project aims to establish a novel prototype for a socially interactive avatar and/or agent based on human sensorimotor communication. It will capture natural body movements, facial expressions and hand gestures to compile an array of sensorimotor primitives: these will aid the design of AI-based architecture of a fully mobile human rendering with customisable characteristics. SHARESPACE will validate the prototype in three real-life situations of shared hybrid spaces involving human and artificial agents in the fields of health, sport and art | ||
=== Project outputs === | |||
==== Publications ==== | |||
{| class="wikitable sortable" | |||
! Domain !! Type of output !! Title !! DOI URL | |||
|- | |||
| AI, Machine Learning & Data Science || Conference proceedings || The Unfaithful Copy: Performed AI ‘Personhood’in Mixed Reality Platforms || https://doi.org/10.32040/2242-122X.2024.T432 | |||
|- | |||
| AI, Machine Learning & Data Science || Conference proceedings || Demonstrating the effectiveness of combining heuristic and data-driven methods to achieve scalable and adaptive motion styles || https://doi.org/10.1109/VRW66409.2025.00144 | |||
|- | |||
| AI, Machine Learning & Data Science || Conference proceedings || Rendering Togetherness: Embodied Social Synchronization in Multi-User VR || https://doi.org/10.1109/ISMAR67309.2025.00079 | |||
|- | |||
| AI, Machine Learning & Data Science || Conference proceedings || Learning-based cognitive architecture for enhancing coordination in human groups || https://doi.org/10.48550/arXiv.2406.06297 | |||
|- | |||
| AI, Machine Learning & Data Science || Conference proceedings || Control- Tutored Deep Reinforcement Learning || https://doi.org/10.48550/arXiv.2212.01343 | |||
|- | |||
| AI, Machine Learning & Data Science || Other || Continuification Control of Large-Scale Multiagent Systems Under Limited Sensing and Structural Perturbations || https://doi.org/10.48550/arxiv.2303.13246 | |||
|- | |||
| AI, Machine Learning & Data Science || Other || Data-driven design of complex network structures to promote synchronization || https://doi.org/10.48550/arxiv.2309.10941 | |||
|- | |||
| AI, Machine Learning & Data Science || Other || Local convergence of multi-agent systems towards triangular patterns || https://doi.org/10.48550/arxiv.2303.11865 | |||
|- | |||
| AI, Machine Learning & Data Science || Peer reviewed articles || Local Convergence of Multi-Agent Systems Toward Rigid Lattices || https://doi.org/10.1109/lcsys.2023.3289060 | |||
|- | |||
| AI, Machine Learning & Data Science || Peer reviewed articles || Guaranteeing Control Requirements via Reward Shaping in Reinforcement Learning || https://doi.org/10.48550/arxiv.2311.10026 | |||
|- | |||
| AI, Machine Learning & Data Science || Peer reviewed articles || Kinematic priming of action predictions || https://doi.org/10.1016/j.cub.2023.05.055 | |||
|- | |||
| AI, Machine Learning & Data Science || Peer reviewed articles || Action prediction in psychosis || https://doi.org/10.1038/s41537-023-00429-x. | |||
|- | |||
| Computer Vision, 3D Modeling & Rendering || Conference proceedings || Improving Image Reconstruction using Incremental PCA-Embedded Convolutional Variational Auto- Encoder || https://doi.org/10.24132/10.24132/CSRN.3401.12 | |||
|- | |||
| Ethics, Society, Arts & Culture || Book chapters || Five Reality Types: The Embedded Ethicist in VR and Mixed-Reality Platforms || https://doi.org/10.1007/978-981-96-1154-6_9 | |||
|- | |||
| Extended Reality (VR/AR/MR) & HCI || Conference proceedings || Multi - Modal Signal Processing for Avatar Motion Adaptation || https://doi.org/10.1109/DSP65409.2025.11075085 | |||
|- | |||
| Healthcare, Medicine & Accessibility || Peer reviewed articles || The emerging role of virtual reality as an adjunct to procedural sedation and anesthesia || https://doi.org/10.3390/jcm12030843 | |||
|- | |||
| Healthcare, Medicine & Accessibility || Peer reviewed articles || Data-driven architecture to encode information in the kinematics of robots and artificial avatars || https://doi.org/10.48550/arXiv.2403.06557 | |||
|- | |||
| Robotics, Manufacturing & Industry 4.0 || Other || eXtended Reality of socio-motor interactions: Current Trends and Ethical Considerations for Mixed Reality Environments Design || https://doi.org/10.1145/3610661.361798 | |||
|- | |||
| Robotics, Manufacturing & Industry 4.0 || Peer reviewed articles || Distributed control for geometric pattern formation of large-scale multirobot systems || https://doi.org/10.48550/arXiv.2207.14567 | |||
|} | |||
==== Technological assets ==== | |||
{| class="wikitable sortable" | |||
! Domain !! Title !! Type of Asset !! Link / DOI !! Description | |||
|- | |||
| Digital, Industry & Space || CT-DQN: Control-Tutored Deep Reinforcement Learning || AI Model / Software || https://doi.org/10.48550/arXiv.2212.01343 || Code base and model architecture for a control-tutored deep reinforcement learning methodology. | |||
|- | |||
| Digital, Industry & Space || Deep Space Starter Kit || Software || https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-Starter || The Deep Space Starter Kit is an Unreal Engine template includes all configurations to quickly start a new project for this specific space. This plug-in is compatible with Unreal Engine 5.7. | |||
|- | |||
| Culture, creativity || pharus || Plug-in || https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-PharusLasertracking || The pharus tracking system is developed by researcher and artist Otto Naderer from the Ars Electronica Futurelab. This tracking system allows for the locations of objects, people, or groups to be tracked on the Deep Space floor. | |||
|- | |||
| Culture, creativity || Deep Sync Infrastructure || Plug-in || https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-DeepSync https://github.com/ArsElectronicaFuturelab/DeepSync-Wearable-Server https://github.com/ArsElectronicaFuturelab/DeepSync-Wearable-Firmware || The Deep Sync Infrastructure brings biodata to the co-immersive Deep Space 8K. It includes the development of custom-made wearables and an Unreal Engine plug-in. | |||
|- | |||
| Culture, creativity || Cognitive Architectures || Plug-ins || https://sharespace.eu/cognitive-architectures/ || Within SHARESPACE, cognitive architectures were designed, developed, and validated by SHARESPACE partner CRdC to drive the movement of virtual characters with different levels of autonomization. | |||
|- | |||
| Culture, creativity || Pixel Streaming Service || Plug-in || https://github.com/ALE-Rainbow/sharespace-pixel-streaming-infrastructure || WebRTC enables direct peer-to-peer audio connections that avoid the mixing delays inherent in centralized voice systems. A mesh network architecture allows multiple P2P connections between emitters and receivers, minimizing latency while maintaining audio quality. | |||
|- | |||
| Culture, creativity || Web Client-Server Bundle || Plug-in || https://github.com/ALE-Rainbow/sharespace-pixel-streaming-cpp-service || The project delivered a web client-server bundle that could be hosted either locally or in ALE cloud with connectors for direct connection with XR applications. | |||
|- | |||
| Culture, creativity || Avatar Replication in Shared Environments || Plug-in || https://github.com/CYENS/virtual-share-space || A unified multi-user platform was developed in Unreal Engine 5 by the team of Cyens, allowing distributed clients to connect and interact within shared virtual environments. | |||
|} | |||
Latest revision as of 12:47, 22 April 2026
SHARESPACE Project
| CORDIS Reference | Start date | End date | Coordinator | Project website |
|---|---|---|---|---|
| https://cordis.europa.eu/project/id/101092889 | 01/01/2023 | 31/12/2025 | DFKI | https://sharespace.eu/ |
Project description
Extended reality (XR) is an emerging technology with promising potential in many areas, but several limitations must be overcome to enrich the interactive experience for users. The EU-funded SHARESPACE project aims to establish a novel prototype for a socially interactive avatar and/or agent based on human sensorimotor communication. It will capture natural body movements, facial expressions and hand gestures to compile an array of sensorimotor primitives: these will aid the design of AI-based architecture of a fully mobile human rendering with customisable characteristics. SHARESPACE will validate the prototype in three real-life situations of shared hybrid spaces involving human and artificial agents in the fields of health, sport and art
Project outputs
Publications
| Domain | Type of output | Title | DOI URL |
|---|---|---|---|
| AI, Machine Learning & Data Science | Conference proceedings | The Unfaithful Copy: Performed AI ‘Personhood’in Mixed Reality Platforms | https://doi.org/10.32040/2242-122X.2024.T432 |
| AI, Machine Learning & Data Science | Conference proceedings | Demonstrating the effectiveness of combining heuristic and data-driven methods to achieve scalable and adaptive motion styles | https://doi.org/10.1109/VRW66409.2025.00144 |
| AI, Machine Learning & Data Science | Conference proceedings | Rendering Togetherness: Embodied Social Synchronization in Multi-User VR | https://doi.org/10.1109/ISMAR67309.2025.00079 |
| AI, Machine Learning & Data Science | Conference proceedings | Learning-based cognitive architecture for enhancing coordination in human groups | https://doi.org/10.48550/arXiv.2406.06297 |
| AI, Machine Learning & Data Science | Conference proceedings | Control- Tutored Deep Reinforcement Learning | https://doi.org/10.48550/arXiv.2212.01343 |
| AI, Machine Learning & Data Science | Other | Continuification Control of Large-Scale Multiagent Systems Under Limited Sensing and Structural Perturbations | https://doi.org/10.48550/arxiv.2303.13246 |
| AI, Machine Learning & Data Science | Other | Data-driven design of complex network structures to promote synchronization | https://doi.org/10.48550/arxiv.2309.10941 |
| AI, Machine Learning & Data Science | Other | Local convergence of multi-agent systems towards triangular patterns | https://doi.org/10.48550/arxiv.2303.11865 |
| AI, Machine Learning & Data Science | Peer reviewed articles | Local Convergence of Multi-Agent Systems Toward Rigid Lattices | https://doi.org/10.1109/lcsys.2023.3289060 |
| AI, Machine Learning & Data Science | Peer reviewed articles | Guaranteeing Control Requirements via Reward Shaping in Reinforcement Learning | https://doi.org/10.48550/arxiv.2311.10026 |
| AI, Machine Learning & Data Science | Peer reviewed articles | Kinematic priming of action predictions | https://doi.org/10.1016/j.cub.2023.05.055 |
| AI, Machine Learning & Data Science | Peer reviewed articles | Action prediction in psychosis | https://doi.org/10.1038/s41537-023-00429-x. |
| Computer Vision, 3D Modeling & Rendering | Conference proceedings | Improving Image Reconstruction using Incremental PCA-Embedded Convolutional Variational Auto- Encoder | https://doi.org/10.24132/10.24132/CSRN.3401.12 |
| Ethics, Society, Arts & Culture | Book chapters | Five Reality Types: The Embedded Ethicist in VR and Mixed-Reality Platforms | https://doi.org/10.1007/978-981-96-1154-6_9 |
| Extended Reality (VR/AR/MR) & HCI | Conference proceedings | Multi - Modal Signal Processing for Avatar Motion Adaptation | https://doi.org/10.1109/DSP65409.2025.11075085 |
| Healthcare, Medicine & Accessibility | Peer reviewed articles | The emerging role of virtual reality as an adjunct to procedural sedation and anesthesia | https://doi.org/10.3390/jcm12030843 |
| Healthcare, Medicine & Accessibility | Peer reviewed articles | Data-driven architecture to encode information in the kinematics of robots and artificial avatars | https://doi.org/10.48550/arXiv.2403.06557 |
| Robotics, Manufacturing & Industry 4.0 | Other | eXtended Reality of socio-motor interactions: Current Trends and Ethical Considerations for Mixed Reality Environments Design | https://doi.org/10.1145/3610661.361798 |
| Robotics, Manufacturing & Industry 4.0 | Peer reviewed articles | Distributed control for geometric pattern formation of large-scale multirobot systems | https://doi.org/10.48550/arXiv.2207.14567 |
Technological assets
| Domain | Title | Type of Asset | Link / DOI | Description |
|---|---|---|---|---|
| Digital, Industry & Space | CT-DQN: Control-Tutored Deep Reinforcement Learning | AI Model / Software | https://doi.org/10.48550/arXiv.2212.01343 | Code base and model architecture for a control-tutored deep reinforcement learning methodology. |
| Digital, Industry & Space | Deep Space Starter Kit | Software | https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-Starter | The Deep Space Starter Kit is an Unreal Engine template includes all configurations to quickly start a new project for this specific space. This plug-in is compatible with Unreal Engine 5.7. |
| Culture, creativity | pharus | Plug-in | https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-PharusLasertracking | The pharus tracking system is developed by researcher and artist Otto Naderer from the Ars Electronica Futurelab. This tracking system allows for the locations of objects, people, or groups to be tracked on the Deep Space floor. |
| Culture, creativity | Deep Sync Infrastructure | Plug-in | https://github.com/ArsElectronicaFuturelab/UE-DeepSpace-DeepSync https://github.com/ArsElectronicaFuturelab/DeepSync-Wearable-Server https://github.com/ArsElectronicaFuturelab/DeepSync-Wearable-Firmware | The Deep Sync Infrastructure brings biodata to the co-immersive Deep Space 8K. It includes the development of custom-made wearables and an Unreal Engine plug-in. |
| Culture, creativity | Cognitive Architectures | Plug-ins | https://sharespace.eu/cognitive-architectures/ | Within SHARESPACE, cognitive architectures were designed, developed, and validated by SHARESPACE partner CRdC to drive the movement of virtual characters with different levels of autonomization. |
| Culture, creativity | Pixel Streaming Service | Plug-in | https://github.com/ALE-Rainbow/sharespace-pixel-streaming-infrastructure | WebRTC enables direct peer-to-peer audio connections that avoid the mixing delays inherent in centralized voice systems. A mesh network architecture allows multiple P2P connections between emitters and receivers, minimizing latency while maintaining audio quality. |
| Culture, creativity | Web Client-Server Bundle | Plug-in | https://github.com/ALE-Rainbow/sharespace-pixel-streaming-cpp-service | The project delivered a web client-server bundle that could be hosted either locally or in ALE cloud with connectors for direct connection with XR applications. |
| Culture, creativity | Avatar Replication in Shared Environments | Plug-in | https://github.com/CYENS/virtual-share-space | A unified multi-user platform was developed in Unreal Engine 5 by the team of Cyens, allowing distributed clients to connect and interact within shared virtual environments. |