A book chapter entitled “The Rise of Multimodal Tutors in Education” written by Daniele Di Mitri, Jan Schneider & Hendrik Drachsler was published open access in the “Handbook of Open, Distance and Digital Education” edited by Olaf Zawacki-Richter and Insung Jung.
Abstract
This chapter describes the insights derived from the design and development of the Multimodal Tutor, a system that uses artificial intelligence to provide digital feedback and support psychomotor skills acquisition. In this chapter, we discuss the insights which we gained from eight studies: (1) an exploratory study combining physiological data and learning performance (Learning Pulse); (2) a literature survey on multimodal data for learning and a conceptual model (the Multimodal Learning Analytics Model); (3) an analysis of the technical challenges of Multimodal Learning Analytics (the Big Five Challenges); (4) a technological framework for using multimodal data for learning (the Multimodal Pipeline); (5) a data collection and storing system for multi-modal data (the Learning Hub); (6) a data annotation tool for multimodal data (the Visual Inspection Tool); (7) a case study in Cardiopulmonary Resuscitation Training (CPR Tutor) consisting of a feasibility study for detecting CPR mistakes; and (8) a real-time feedback study.
Citation:
Di Mitri, D., Schneider, J., Drachsler, H. (2022). The Rise of Multimodal Tutors in Education. Handbook of Open, Distance and Digital Education. Springer, Singapore. https://doi.org/10.1007/978-981-19-0351-9_58-1