New Pub: Keep Me in the Loop: Real-Time Feedback with Multimodal Data
Title: Keep Me in the Loop: Real-Time Feedback with Multimodal Data Authors: Daniele Di Mitri, Jan Schneider & Hendrik Drachsler Journal: International Journal of Artificial Intelligence in Education (2021) Abstract: This paper describes the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects training mistakes using recurrent neural networks. The CPR Tutor automatically recognises and assesses the quality of the chest compressions according to five CPR performance indicators. It detects training mistakes in real-time by analysing a multimodal data stream consisting of kinematic and electromyographic data. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. The mistake detection models of the CPR Tutor were trained using a dataset from 10 experts.…