UNSW Sydney has commenced a strategic collaboration with the ACE Training Centre at Toll Group Government and Defence to develop a next-generation mixed reality helmet-based training system. The project is funded by the Defence Trailblazer’s Accelerating Sovereign Industrial Capabilities (ASIC) program, a bespoke initiative supported by the Australian Department of Education.

The project will deliver scalable, cost-effective immersive training solutions for individuals and teams across the Australian Defence Force (ADF). Unlike current VR/XR systems—which are costly, time-consuming to adapt, and incompatible with standard issue helmets—this new system will integrate seamlessly with operational headwear, offering realistic communications and night vision capabilities.

Led by Professor John McGhee, director of UNSW’s 3DXLab at the Faculty of Arts, Design & Architecture, the project builds on a longstanding partnership with the ACE Training Centre and a shared history of innovation in Mixed Augmented Virtual Reality (MAV) technologies.

“We will focus on expanding the system’s capabilities, including integrating existing training systems and databases,” said Professor McGhee. “Concurrently, we will design and develop synthetic XR 3D virtual models for diverse training scenarios and produce a prototype system.”

Perry Singh, President of Toll Government and Defence, said: “By developing a system that can be attached to any operational helmet and leveraging commercial XR technology, the project will lead to an easily implemented, yet comprehensive, training capability that can be broadly utilised by the ADF.”

The project reflects UNSW’s commitment to world-class research and industry collaboration that leads to real-world impact.

The 3DXLab is a multi-disciplinary research lab that harnesses the power of cutting-edge immersive technologies to conduct visualisation research from a design-centred perspective.

“By leveraging world-class research and cutting-edge technologies, creative techniques from VFX, animation, and video games, we strive to create extraordinary digital experiences. Our ultimate goal is to harness the potential of the digital realm for the advancement of the physical world,” says Prof. McGhee.