In the rapidly evolving landscape of education, the integration of technology in learning processes has become a pivotal element. The recent workshop on Multimodal Technologies for Skills Development, hosted at the JTEL summer school, stands as a testament to this transformation.

The Workshop Overview
The workshop, aptly titled “Multimodal Technologies for Skills Development (mute4skid),” was a comprehensive event that explored the utilization of AI and multimodal systems in the realm of education. It was structured in two parts, offering theoretical insights and practical applications.

The speakers 
The speakers for the “Multimodal Technologies for Skills Development” workshop were:

  • Daniele Di Mitri, DIPF, Germany
  • Jan Schneider, DIPF, Germany
  • Bibeg Limbu, University of Duisburg
  • Khaleel Asyraaf Mat Sanusi, Cologne Game Lab, TH Köln, Germany
  • Roland Klemke, Open University of The Netherlands, The Netherlands / TH Köln, Germany

Morning Session: Theoretical Insights
The morning session started with a lecture-style presentation introducing the rationale behind AI in education for skills development. The speakers, part of the EATEL SIG in AI in Education, presented concrete examples from their research on multimodal technologies for skill development.

Participants engaged in brainstorming and group work, discussing how to advance skills development using multimodal technologies. This session provided a deep understanding of AI in education, covering its main concepts, historical progression, and the exciting new opportunities presented by multimodal interfaces, sensors, and advanced machine-learning environments.

Afternoon Session: Hands-On Experience
The afternoon session, titled “Capturing Expertise: Recording and Analyzing Psychomotor Skills,” transitioned from theory to practice. Participants explored the nuances of psychomotor skills, understanding the differences in skill execution between experts and novices.

This hands-on session included activities like sharing personal psychomotor skills, selecting skills for recording, and planning the recording process. Participants conducted group recordings to gather data, with repeated sessions to ensure accuracy. The workshop concluded with an analysis of the recordings to gain insights into skill mastery.

The Impact of Multimodal Technologies
Multimodal and immersive systems, such as virtual and augmented reality, are revolutionizing how we interact with technology and learn new skills. These systems enable personalized, contextual, and deliberate practice of skills in real settings, fostering holistic learning that integrates cognitive, affective, and psychomotor domains.

Read more about this in the recent special section in the British Journal of Education Technology.

Challenges and Opportunities
Despite the promising advancements, multimodality in education still faces challenges. The workshop addressed these issues, providing a platform for educators, technologists, and researchers to collaborate and find solutions.

The “Multimodal Technologies for Skills Development” workshop was a significant step towards understanding and harnessing the power of AI and multimodal systems in education. It highlighted the potential of these technologies to transform learning experiences and equip learners with the skills needed for the 21st century.