Effective Telediagnostic Platform with Rich Communication in Sensitive Situations
2020-2022
![Cungchul_project1](https://www.hitlabnz.org/wp-content/uploads/2021/03/Cungchul_project1.jpg)
This project aims to develop an immersive telediagnostic platform for remote sessions in situations where there are sensitive relationships, such as counsellor-patient, which require rich communication cues including non-verbal behaviour and physiological signals.
The information provider (e.g., patient) will wear a virtual reality (VR) headset and see a real counsellor (e.g., doctor) in a virtual space as if meeting in the real world. Verbal and non-verbal behaviours, along with physiological signals, will be collected and analysed using a deep learning approach in real time.
The research team aims to develop the telediagnostic platform, analyse non-verbal cues for rich communication information, and to evaluate the system as an effective consultation tool for complex dyadic conversations.
This project is funded by a grant from the Science for Technological Innovation National Science Challenge (SfTI) – Kia Kotahi Mai: Te Ao Pūtaiao me Te Ao Hangarau programme hosted by Callaghan Innovation and the Ministry of Business, Innovation and Employment.
People
![](https://www.hitlabnz.org/wp-content/uploads/2020/05/Staff-headshots-031HIIT-LABSungchul-Jung-1-scaled.jpg)
Sungchul Jung
![](https://www.hitlabnz.org/wp-content/uploads/2021/03/Dilshani-2.png)
Dilshani Kumarapeli
![](https://www.hitlabnz.org/wp-content/uploads/2021/03/Simon-Hoermann_resize.jpg)
Simon Hoermann
![](https://www.hitlabnz.org/wp-content/uploads/2020/06/Staff-headshots-031HIIT-LABRob-Lindeman-1-scaled-1.jpg)
Rob Lindeman
![](https://www.hitlabnz.org/wp-content/uploads/2020/11/Tham-1.jpg)