3D Visualisation Aesthetics Lab Projects

Nanoscape is a data-driven 3D real-time interactive virtual cell environment.

The biological world at the molecular level is a complex and chaotic place. Striving for increased authenticity in real-time 3D computer visualisations and animations is aesthetically and computationally challenging due to extreme molecular crowding and large variations in spatio-temporal scales.

In this work, a data-first approach has been employed to visualise activity on the surface of a cancer cell in situ. Leveraging advances in GPU instancing and parallelism combined with emerging data regarding densities, scales and dynamics of cellular entities, Nanoscape aims to immerse the viewer in an unparalleled interactive real-time-rendered cellular exploration. This pioneering work will allow reflection, speculation and a much deeper fundamental understanding of the complex world inside the human body.

Desktop and VR versions of Nanoscape have been released for public use and are available on the Steam store:

https://store.steampowered.com/app/1654050/Nanoscape/

https://store.steampowered.com/app/1634740/Nanoscape_VR/

Collaborators: Prof Kris Thurecht and Prof Rob Parton (University of Queensland), A/Prof Angus Johnston (Monash University), Prof Maria Kavallaris, Prof Matthew Kearnes, Dr Declan Kuch (UNSW)

When the world was confronted with the COVID-19 pandemic, an imperative health message circulated urging the public to wash their hands regularly with soap and water to help stem the spread of the virus, yet little had been described about exactly how soap interacts with these infectious agents at the molecular level.

In collaboration with biochemical science professor, Pall Thordarson, the 3DVAL undertook a visualisation project to unveil these mysterious mechanisms and to increase public awareness of the importance of handwashing. The piece was selected for the prestigious Computer Animation Festival at the 2020 SIGGRAPH Asia conference.

Read more about Soap vs COVID-19

Collaborator: Prof Pall Thordarson (UNSW)

The ability to convincingly immerse a viewer in an alternate reality remains the cornerstone of VR technology and the foundation of this collaborative project. We are exploring how distraction through gamified exploration of virtual worlds affects the perception of acute pain experienced by hospital patients.

In collaboration with medical experts at the St Vincent’s Hospital Sydney, the 3DVAL team are developing applications that run on the low-cost and ultra-portable Samsung GearVR headsets as a novel approach to pain management.

The project investigates the role of aesthetics and design principles (such as colour and interactivity) in boosting the psycho-physiological defences against the perception of pain.

Collaborators: Prof Steven Faux, Dr Christine Shiner (St Vincent’s Hospital)

Sponsored by Samsung

Interactive cell exploration

In 2016, an interactive virtual reality cell environment, the first of its kind, was generated at the 3D Visualisation Aesthetics Lab. The prototype uses the latest room-scale virtual reality technology and high-resolution electron microscopy data to allow researchers to observe the processes by which nanoparticles carrying cancer therapies are internalised and trafficked within a cancer cell. It is anticipated that this work will shift the paradigm of education while accelerating the science discovery process by offering researchers novel perspectives on drug delivery. Initial assessment of the learning outcomes of immersive media education compared with traditional screen-based methods in undergraduate students suggests VR can improve learning but further work is needed.

Watch a video flythrough of the VR cell environment

Educational animation

Based on ground-breaking research being undertaken by scientific collaborators at the Monash Institute of Pharmaceutical Science (MIPS) and the University of Queensland (UQ), the 3DVAL developed a thought-provoking computer-generated animation describing the stages of novel nanoparticle drug delivery to cancer cells isolated in the laboratory. The sequence incorporates accurate high-resolution microscopy data of a breast cancer cell and structural data from the Protein Data Bank to enhance scientific authenticity.

Watch an animation describing the latest research developments in nanoparticle-based cancer therapies

Design-led visualisation of nanomedicines in virtual reality

This research explores how VR can be used as a platform to understand and interact with pre-clinical imaging data – specifically PET-CT- in an immersive and intuitive manner. This interdisciplinary research work is being carried out between the 3D Visualisation Aesthetics Lab (3DVAL) at UNSW Sydney and the Australian Institute for Bioengineering and Nanotechnology/Centre for Advanced Imaging at The University of Queensland, Australia. The project focuses on how carefully-considered aesthetic and design choices such as colour, environment, sound and interface features, can enhance the user experience and comprehension of the 3D data sets.

Read more about design-led 3D visualisation of nanomedicines in VR

Collaborators: Prof Kris Thurecht, Dr Zach Houston, Dr Nick Fletcher (University of Queensland)

Funded by the ARC Centre of Excellence in Convergent Bio-Nano Science & Technology (CBNS)

3D MED-i explores immersive arts-led 3D visualisation approaches using Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) data in stroke patients.

The 3DVAL are developing customised pipelines and rendering tools that allow real-time, interactive exploration of dense data sets containing millions of data points.

A key area of investigation for the 3DVAL is multi-user/social virtual reality, a powerful tool for communication and collaboration.

In collaboration with the Garvan-Weizmann Institute, the 3DVAL has developed an immersive VR experience designed to educate and inspire the viewer in the research field of molecular genomics.