Workshop: Hyperchalk – How to implement Self-hosted Whiteboard Tasks @ JTEL Summer School 2023

Workshop: Hyperchalk – How to implement Self-hosted Whiteboard Tasks @ JTEL Summer School 2023

Artificial Intelligence, Computer-supported collaborative learning, Learning Analytics, Summer School, Workshop
In this workshop which Lukas Menzel and I gave at the seventeenth JTEL Summer School, we explored the possibilities of our self-implemented whiteboard tool Hyperchalk. Hyperchalk is a backend for Excalidraw which allows for integrating learning management systems via LTI and collecting a complete history of trace data. After a short kick-off presentation, we let the participants design their own learning activities using the whiteboard. All participants created little tasks that other participants then solved. As most participants had a strong background in teaching, these were inspired by practical experiences. The tasks involved various topics, from stochastics to K12-level geography. At the end of the workshop, we taught the participants how to administrate the tool and how to set it up on their own servers. Overall, it was a successful…
Read More
Workshop @ JTELSS – Visualizing Real-World Learning Analytics

Workshop @ JTELSS – Visualizing Real-World Learning Analytics

Learning Analytics, Self-Regulation, Workshop
In this workshop, Atezaz Ahmad, Kamran Mir, Jan Schneider and Daniele Di Mitri presented two datasets (IWWB and Presentation Trainer) to the participants. There were three main tasks: Investigate the datasets and how it could be used to design analytics dashboards. - Participants were asked to use HyperChalk and OpenLAIR to design their solutions. What are some limitations of the current datasets. - List the problems/issues with the datasets and how to improve them. What indicators will we get from this datasets. - List/Name the indicators. At the end of the workshop, we asked the participants to fill out a survey. The survey was about evaluating the IWWB+ analytics dashboard. Here are some pictures of the results:
Read More
Keynote @ #JTELSS23 – Towards Highly Informative Learning Analytics

Keynote @ #JTELSS23 – Towards Highly Informative Learning Analytics

Conference, Feedback, Higher Education, Keynote, Learning Analytics, Learning Design, Summer School
Hendrik Drachsler delivered a keynote presentation at the 17th EATEL Summer School on Technology-Enhanced Learning (JTELSS 2023) in La Manga, Spain that unveiled groundbreaking insights from the Highly Informative and Learning Analytics (HILA) research program. This exciting initiative explores the effectiveness of HILA and the transformative power of data-enriched learning activities in providing highly informative feedback to students. Here a few highlights from Hendrik's keynote, showcasing the potential of HILA to revolutionize learning outcomes. The Power of Feedback Extensive research has long recognized the profound impact of feedback on learning success. Hendrik's presentation revealed that HILA surpasses traditional feedback methods by offering even higher efficacy. By going beyond simple right or wrong responses, HILA provides actionable feedback that enables students to exercise effective metacognitive control over their learning process. This…
Read More
New pub: Measuring Collaboration Quality Through Audio Data and Learning Analytics

New pub: Measuring Collaboration Quality Through Audio Data and Learning Analytics

Book chapter, Computer-supported collaborative learning, Learning Analytics, Multimodal Learning Analytics
In the rapidly evolving twenty-first century, collaboration stands as a vital skill. Recognizing its significance, the detection of collaboration quality can play a pivotal role in fostering effective teamwork. This newly published chapter dives into the realm of collaboration quality detection and measurement, aiming to achieve the following objectives: Defining collaboration quality by leveraging audio data and unobtrusive learning analytics measures. Detailing the design of a sensor-based setup specifically tailored for automatic collaboration analytics. Advancing the quantification of collaboration quality through the utilization of this setup and presenting the analysis using insightful visualizations. Moreover, the chapter delves into the challenges and issues at hand while exploring potential solutions that build upon existing research. To elucidate the various objectives, the terminology of "indicators" (i.e., the events) and "indexes" (i.e., the process)…
Read More
New pub: Lernpfade in adaptiven und künstlich-intelligenten Lernprogramme

New pub: Lernpfade in adaptiven und künstlich-intelligenten Lernprogramme

Artificial Intelligence, Book chapter, Learning Analytics, Research Methods
In this newly published book chapter, the authors delve into the comparison between interactive, adaptive and artificially intelligent learning programs. While adaptive and AI-based applications offer promising potential, they face greater complexity in their development and have yet to fully establish themselves. To evaluate the prospects of these technologies, their respective capabilities are explored. Adaptive learning programs prove effective in skill acquisition, while AI-based solutions shine in cases where an explicit expertise model is challenging to articulate. The didactic and pedagogical challenges that lie ahead for AI-based learning applications are also highlight. By examining these factors, valuable insights are gained into the landscape of advanced learning technologies and their future implications. Reference: Kerres, M., Buntins, K., Buchner, J., Drachsler, H., & Zawacki-Richter, O.. (In Press). Lernpfade in adaptiven und künstlich-intelligenten…
Read More
New pub: Evaluating the Impact of FoLA on Learning Analytics Knowledge Creation

New pub: Evaluating the Impact of FoLA on Learning Analytics Knowledge Creation

Journal, Learning Analytics, Learning Design, Publication, Research Methods, Research topic, Special Issue
Learning analytics provides opportunities to improve the design of learning activities by supplying information on the effects of different learning approaches. Despite the existence of design methods that aim to facilitate the incorporation of learning analytics into learning design, there is a lack of research assessing their efficacy. This study aims to evaluate the effectiveness of the FoLA2 method. In higher education settings, sixty participants utilized the FoLA2 method to develop fourteen learning activities. To gauge the impact, participants completed a technology acceptance test before and after each session. Furthermore, researchers analyzed audio recordings of the sessions using epistemic network analysis to gain insights into the discussions regarding learning analytics and the creation of enhanced learning activities. The results from both the technology acceptance test and the epistemic network analysis…
Read More
New pub: Digitalisierung und Diagnostik in Schulen – Herausforderungen für Bildungspraxis und Bildungsforschung

New pub: Digitalisierung und Diagnostik in Schulen – Herausforderungen für Bildungspraxis und Bildungsforschung

Assessment, Book chapter, Computational Psychometrics, Digitalisation, Learning Analytics, Research Methods, Research topic, School
In the spring of 2020, schools faced an unprecedented challenge as the pandemic disrupted traditional modes of instruction and school development. With on-site learning replaced by digital formats and distance communication, educators had to quickly adapt to the new normal. Amidst these changes, the field of education encountered specific challenges related to digital school management, digital learning, and assessing learning progress. Particularly, computer-aided diagnostics emerged as a valuable tool for gaining insights not only into learning outcomes but also into the learning process itself. Researchers became intrigued by the potential of digital media in shaping learning experiences and how the resulting data could be effectively utilized in educational practice. This paper explores the current challenges and potentials in computer-based, learning-accompanying diagnostics. The primary hurdles involve implementing suitable instruments within schools…
Read More
A Vibrant Week of Exchange Between Brazilian and German LA Researchers

A Vibrant Week of Exchange Between Brazilian and German LA Researchers

Higher Education, Learning Analytics, Multimodal Learning Analytics, Research Methods, Research topic, Workshop
From May 22 to 25, 2023 five esteemed guest researchers from Brazil visited the EduTec team in Frankfurt in the context of the Humboldt Foundation's Connect Program. This productive exchange not only shed light on the current state of Learning Analytics (LA) research in Brazil and Germany but also paved the way for potential collaborative research activities. Status of LA research in Brazil The week began with a discussion of the role of LA in the global South. Rafael Ferreira Mello from the Federal Rural University of Pernambuco (UFRPE) emphasized the importance of adapting LA methodologies to the specific context and needs of Brazil, ensuring inclusivity and accessibility in educational initiatives. Diego Dermeval from the Universidade Federal de Alagoas (UFAL) highlighted the potential of AI and LA in supporting teachers…
Read More
New research program: Towards Highly Informative Learning Analytics

New research program: Towards Highly Informative Learning Analytics

Artificial Intelligence, Assessment, Book, Computational Psychometrics, Computer-supported collaborative learning, Feedback, Further Education, Higher Education, Keynote, Learning Analytics, Learning Design, Research Methods, School
On May 12, 2023, the Highly Informative Learning Analytics (HILA) research program of the EduTec@DIPF, studiumdigitale@Goethe University Frankfurt and the Open Learning and Instruction group@Open Universiteit was presented by Hendrik Drachsler at the main campus of the Open University of the Netherlands. The release of the HILA research program marks a significant milestone for the collaboration in the field of learning analytics between of the Dutch-German research collective.  The HILA research program is focused on developing new tools and methods to collect, analyze, and interpret data that can help educational institutions to understand the learning process better. As part of the program's launch, a keynote by Ioana Jivet on student-facing learning analytics was provided. Ioana reported on two empirical studies investigating the effect of data-driven feedback on students. [pdf-embedder url="https://edutec.science/wp-content/uploads/2023/05/2023_05-Keynote-Symposium-Hendrik.pdf"…
Read More
New Pub: A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards

New Pub: A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards

Journal, Learning Analytics, Publication
Higher education institutions are moving to design and implement teacher-facing learning analytics (LA) dashboards with the hope that instructors can extract deep insights about student learning and make informed decisions to improve their teaching. While much attention has been paid to developing teacher-facing dashboards, less is known about how they are designed, implemented and evaluated. This paper presents a systematic literature review of existing studies reporting on teacher-facing LA dashboards. Out of the 1968 articles retrieved from several databases, 50 articles were included in the final analysis. Guided by several frameworks, articles were coded based on the following dimensions: purpose, theoretical grounding, stakeholder involvement, ethics and privacy, design, implementation, and evaluation criteria. The findings show that most dashboards are designed to increase teachers’ awareness but with limited actionable insights to…
Read More