Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Artificial Intelligence, Assessment, Award, Computational Psychometrics, Conference, Higher Education, New Pub, Workshop
For standardized exams to be fair and reliable, they must include a diverse range of question difficulties to accurately assess test taker abilities. Additionally, it's crucial to balance the time allotted per question to avoid making the test unnecessarily rushed or sluggish. The goal of this year's BEA shared task (competition) was to build systems which could predict Item Difficulty and Item Response Time for items taken from the United States Medical Licensing Examination (USMLE). EduTec member Sebastian Gombert designed systems which are able to predict both variables simultaneously. These placed first out of 43 for predicting Item Difficulty and fitfth out of 34 for predicting Item Response Time. They use modified versions of established transformer language models in a multitask setup. A corresponding system description paper titled Predicting Item…
Read More
Enhancing Learning with Data-enriched Activities: Insights from the HIKOF/IMPACT Workshop at eLearning Netzwerktag 2023

Enhancing Learning with Data-enriched Activities: Insights from the HIKOF/IMPACT Workshop at eLearning Netzwerktag 2023

Conference, Event, Feedback, Higher Education, Learning Analytics, Learning Design, Project, Workshop
At the 16te eLearning Netzwerktag 2023, participants had the opportunity to engage in various thought-provoking workshops. One workshop that stood out was the HIKOF/IMPACT session, where the edutec.science members from these AI projects shed light on the development of Data-enriched Learning Activities (DeLAs). This interactive workshop showcased how DeLAs offer valuable insights into students' competency development within digital learning activities. Let's delve into the details of how the HIKOF/IMPACT projects, part of the HILA research program, are revolutionizing eLearning through the implementation of DeLAs. The HIKOF/IMPACT workshop focused on exploring the concept and implementation of Data-enriched Learning Activities. Through DeLAs, educators gain unique insights into students' competency development during digital learning processes. These activities represent a powerful approach that leverages AI to analyze real-time data and provide highly informative feedback…
Read More
Conference: Demo and paper presentations at EARLI 2023

Conference: Demo and paper presentations at EARLI 2023

Artificial Intelligence, Conference, Feedback, Higher Education, Learning Analytics, Self-Regulation, Workshop
This year, the biannual EARLI conference took place between 21-26 August 2023 in Thessaloniki, Greece and EduTec member Ioana Jivet represented DIPF with two contributions. The 1.5-hour ICT demo Closing the Feedback Loop - A Moodle Plugin for (Semi-)automated Feedback introduced participants to the work of PhD student Tornike Giorgashvili, supervised by Hendrik Drachsler and Ioana Jivet, and the outcomes of the HIKOF project: LearnDashPlus, a Moodle plugin which helps teachers provide written feedback in large courses. This tool also prompts students to reflect on the feedback they received and allows teachers to explore if such feedback helps students to understand their learning behavior and improve their learning performance. Our tool is intended to work as an educational intervention and an instrument of dialogue between teachers and students and thus closing…
Read More
Workshop: 5th CARLA Workshop at ECTEL 2023

Workshop: 5th CARLA Workshop at ECTEL 2023

Conference, Learning Analytics, Workshop
The fifth edition of Workshop on Culturally Aware Learning Analytics (CARLA) was organised by Ioana Jivet from Goethe University and DIPF together with Maren Scheffel from Ruhr University Bochum and Olga Viberg from KTH Stockholm. During the workshop, the participants were engaged in discussions around the design of educational technologies and rated the workshop positively. The rationale behind the workshop is that learning analytics (LA) have been implemented in various countries, often at a limited scale. We have also seen that LA have been used in different ways in different countries. This makes the transfer of LA solutions from one country to another challenging, due to varying contextual, technical, and cultural factors. In this workshop, we aim to identify and discuss possible cultural differences and also similarities–the factors that have…
Read More
Reflecting on the 10th German Learning Analytics Workshop at DELFI 2023: A Decade of Insights and Lessons Introduction

Reflecting on the 10th German Learning Analytics Workshop at DELFI 2023: A Decade of Insights and Lessons Introduction

Conference, Higher Education, Learning Analytics, School, Workshop
On September 11, 2023, the 10th Learning Analytics Workshop took place during the DELFI’23 and HDI’23 conferences in Aachen, Germany. This year marked a special milestone for the workshop as it celebrated "Ten years of learning analytics in German-speaking space: Success, failure and lessons learned." Co-organized by Ioana Jivet and featuring Hendrik Drachsler as a panelist, the workshop aimed to provide a comprehensive platform for sharing experiences, discussing research, and contemplating the future of learning analytics. A decade in review learning analytics has come a long way since its inception. Initially a niche area, it has now become an integral part of e-learning research, gaining prominence at international conferences like LAK and EDM. The recent pandemic-induced digitization in educational institutions has only accelerated this trend, making LA more visible and…
Read More
Keynote: Teaching with AI?! School in the Era of ChatGPT and Chatbots

Keynote: Teaching with AI?! School in the Era of ChatGPT and Chatbots

Artificial Intelligence, Invited talk, Transfer Activity, Workshop
Last week, the University of Hildesheim hosted an enlightening keynote by Sebastian Wollny on the topic, "Unterricht mit KI?! Schule in Zeiten von ChatGPT und Chatbots" (Teaching with AI?! School in the Era of ChatGPT and Chatbots). This thought-provoking presentation unfolded a narrative that encompassed the history of chatbots, their profound influence on our daily lives, three pivotal areas for their application in education, and the evolving role of educators. The keynote was a pivotal event within the framework of the teacher training program, "Digitalisierung in der Unterrichtspraxis: Erprobte Konzepte und Tools für den Fachunterricht" (Digitalization in Teaching Practice: Tested Concepts and Tools for Subject Instruction). It brought together approximately 50 enthusiastic educators from across Lower Saxony, all eager to enhance their teaching through digital means. Aside from Sebastian Wollny's…
Read More
Workshop: “Anwendungsfelder von (KI-) Lerntechnologien” Klausurtagung Landesamt für Schule und Bildung Sachsen

Workshop: “Anwendungsfelder von (KI-) Lerntechnologien” Klausurtagung Landesamt für Schule und Bildung Sachsen

Transfer Activity, Workshop
Auf der 2. Klausurtagung des Landesamts für Schule und Bildung Sachsen, die am 22. und 23. August 2023 in Meißen stattfand, leitete Onur Karademir einen Workshop mit dem Titel "Anwendungsfelder von (KI-) Lerntechnologien". Der Schwerpunkt lag auf den Gelingensbedingungen für den Transfer von Bildungsinnovationen im Bereich EdTech in Schulen. Im Rahmen des Workshops wurden verschiedene Lerntechnologien im Bildungskontext vorgestellt, darunter Intelligente Tutorensysteme (ITS), Teacher-Dashboards sowie automatische Freitextauswertung und Feedback-Generierung. Besonderes Augenmerk lag auf der Diskussion des Potenzials von ITS und Adaptiven Lernsystemen. Diese Werkzeuge bieten die Möglichkeit zur skalierbaren Binnendifferenzierung, indem sie individuelles Lernen in eigenem Tempo und auf individuellem Niveau während Selbstlernphasen ermöglichen. Ein praktisches Beispiel für Teacher Dashboards wurde am Projekt AFLEK erläutert mit dem Learning Analytics Cockpit (LA Cockpit). Das LA Cockpit soll Lehrkräfte bei der Lernstandsdiagnose der…
Read More
Workshops and tutorials at LASI2023 in Singapore

Workshops and tutorials at LASI2023 in Singapore

Feedback, Learning Analytics, Summer School, Workshop
During 6-8 June 2023, Ioana Jivet participated in the first in-person Learning Analytics Summer Institute (LASI) since 2019, hosted by the National University of Singapore (NUS). The event included a keynote delivered by NUS President Prof. Tan Eng Chye on how NUS is supporting education with educational data, a keynote delivered by Prof. Rebecca Ferguson on the current challenges and opportunities of the field of learning analytics (LA), an expert panel discussing the role of LA in the age of AI and a series of tutorials and workshops conducted by various professionals in the field of LA. As part of the program, Ioana Jivet led a 5.5-hour workshop and a 2-hour tutorial focusing on effective dashboard design, data visualization, and sense-making. The workshop "Effective Dashboard Design and Data Visualization for…
Read More
Workshop: Teacher Dashboards supported by AI-generated Feedback @ JTEL Summer School 2023

Workshop: Teacher Dashboards supported by AI-generated Feedback @ JTEL Summer School 2023

Learning Analytics, School, Summer School, Workshop
At the JTEL Summer School 2023 in La Manga, Spain, we hosted the “Teacher Dashboards supported by AI-generated Feedback” workshop. In this workshop, the Learning Analytics Cockpit (LA Cockpit), a tool developed by us, was presented and optimized by the participants. The LA Cockpit is a teacher dashboard that allows teachers to view the learning status of students through different visualizations and to interact with these visualizations to send feedback to (individual or groups of) students through a feedback system to “steer" the learning process. After a short intro on teacher dashboards and feedback theory, the tool with its visual feedback system was be tested "hands-on" by all participants in the workshop. Afterwards we discussed on how to improve the LA Cockpit and for which purposes teachers would ideally use…
Read More
Workshop: Hyperchalk – How to implement Self-hosted Whiteboard Tasks @ JTEL Summer School 2023

Workshop: Hyperchalk – How to implement Self-hosted Whiteboard Tasks @ JTEL Summer School 2023

Artificial Intelligence, Computer-supported collaborative learning, Learning Analytics, Summer School, Workshop
In this workshop which Lukas Menzel and I gave at the seventeenth JTEL Summer School, we explored the possibilities of our self-implemented whiteboard tool Hyperchalk. Hyperchalk is a backend for Excalidraw which allows for integrating learning management systems via LTI and collecting a complete history of trace data. After a short kick-off presentation, we let the participants design their own learning activities using the whiteboard. All participants created little tasks that other participants then solved. As most participants had a strong background in teaching, these were inspired by practical experiences. The tasks involved various topics, from stochastics to K12-level geography. At the end of the workshop, we taught the participants how to administrate the tool and how to set it up on their own servers. Overall, it was a successful…
Read More