developing a context-aware collaborative AI system to reduce cognitive load and workload for operators in a submarine control room using the CRUSE console simulator
Image source: Department of Defence
Key Points
- DAIRNet Theme: Human – AI Interaction
- Australian Catholic University, Western Sydney University and Total Technology Partners
- Point of contact: Dr Haifeng Shen
This project proposes to develop a voice-over AI assistant (VOAIA) system using open-source and off the shelf AI libraries and devices to automate some of the current functions of the Control Room Use Simulation Environment (CRUSE) simulation platform to reduce cognitive and workload conditions thus improving operational efficiency. It uses a combination of eyetracking, headtracking and handtracking technology to provide situational awareness for the AI system to understand the context of requests made to it by console operators for information.
