Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Artificial Intelligence, Assessment, Award, Computational Psychometrics, Conference, Higher Education, New Pub, Workshop
For standardized exams to be fair and reliable, they must include a diverse range of question difficulties to accurately assess test taker abilities. Additionally, it's crucial to balance the time allotted per question to avoid making the test unnecessarily rushed or sluggish. The goal of this year's BEA shared task (competition) was to build systems which could predict Item Difficulty and Item Response Time for items taken from the United States Medical Licensing Examination (USMLE). EduTec member Sebastian Gombert designed systems which are able to predict both variables simultaneously. These placed first out of 43 for predicting Item Difficulty and fitfth out of 34 for predicting Item Response Time. They use modified versions of established transformer language models in a multitask setup. A corresponding system description paper titled Predicting Item…
Read More
Personalizing running training with immersive technologies using a multimodal framework

Personalizing running training with immersive technologies using a multimodal framework

Journal, New Pub
To improve performance and prevent injuries, running training needs proper personalized supervision and planning. This study examines the factors that influence running training programs, and the benefits and challenges of personalized plans. It also investigates how multimodal, immersive and artificial intelligence (AI) technologies can improve personalized training. We did an exploratory sequential mixed research with running coaches. We analyzed the data and found relevant factors of the training process. We recognized four key aspects for running training: physical, technical, mental and body awareness. We used these aspects to create a framework that proposes multimodal, immersive and AI technologies to help personalized running training. It also lets coaches guide their athletes on each aspect personally. The framework aims to personalize the training by showing how coaches and multimodal learning experience agents…
Read More
New Article – Gender diversity dynamics in a Computer Supported Collaborative Learning

New Article – Gender diversity dynamics in a Computer Supported Collaborative Learning

Artificial Intelligence, Computer-supported collaborative learning, Digitalisation, Empirical Study, Gender, Higher Education, Journal, Learning Design, New Pub, Open access, Publication, Special Issue, Team
🎉 Exciting News! Our article has just been published in the magazine of Computer Assisted Learning! 📰 We delved into the fascinating world of online group learning among adults, unravelling the mysteries of emergent team roles and their intricate connection to gender dynamics in communication. 🌐👥 Have you ever wondered how team roles subtly surface and evolve in online group learning discussions? We did, too! Our research explores the subtle nuances of team roles and their subversive emergence, especially when viewed through the lens of gender diversity, in order to understand how to support more productive learning for all participants. Gender and gender diversity are group features affecting social interaction and are critical for gender-inclusive and equitable education. As such, the role of gender and gender diversity is of particular…
Read More
New Pub: Toward a comprehensive framework of social presence

New Pub: Toward a comprehensive framework of social presence

Computer-supported collaborative learning, Higher Education, Journal, Literature review, New Pub, Open access, Special Issue
Today, students in higher education likely come into contact with different modes of learning, e.g. online learning, blended learning, and, increasingly, hybrid learning. To the extent that communication is mediated by technology in these learning modes, students can experience varying degrees of social presence with regard to their peers. Social presence refers to the feeling that others are 'real' and 'close' despite the physical separation. Especially in learning scenarios that require communication and collaboration, social presence is a crucial consideration. Despite this, research on social presence is fragmented and many other relevant theoretical accounts, while potentially informative, have been neglected. This paper, coauthored by Karel Kreijns, Jane Yau, Joshua Weidlich, and Armin Weinberger, published in Frontiers in Education, Section Digital Education, attempts to provide a comprehensive account of social presence…
Read More
How to improve Knowledge Tracing with hybrid machine learning techniques

How to improve Knowledge Tracing with hybrid machine learning techniques

Journal, New Pub
Knowledge Tracing is a well-known problem in AI for Education. It consists of monitoring how the student's knowledge changes during the learning process and accurately predicting their performance in future exercises. But how can we improve the current methods and overcome their limitations? In recent years, many advances have been made thanks to various machine learning and deep learning techniques. However, they have some pitfalls, such as modelling one skill at a time, ignoring the relationships between different skills, or inconsistent predictions, i.e. sudden spikes and falls across time steps. In our recently published systematic literature review, we aim to illustrate the state of the art in this field. Specifically, we want to identify the potential and the frontiers in integrating prior knowledge sources in the traditional machine learning pipeline…
Read More
New pub: Measuring Efficacy of ALEKS as a Supportive Instructional Tool in K-12 Math Classroom with Underachieving Students

New pub: Measuring Efficacy of ALEKS as a Supportive Instructional Tool in K-12 Math Classroom with Underachieving Students

Assessment, Journal, New Pub, Publication, School
In a recent quasi-experimental research study, the effectiveness of Assessment and Learning in Knowledge Spaces (ALEKS), an Intelligent Tutoring System (ITS), took center stage in the realm of 8th-grade mathematics education. The study aimed to determine whether ALEKS could bring a statistically significant improvement in students' mathematics achievement compared to traditional teacher-led instructions. The research involved 158 8th-grade students categorized as 'underachieving students, with 60 in the teacher-led group and 98 in the ALEKS-led group. The study used a non-randomized approach to compare the outcomes of teacher-led instructions to ALEKS-led instructions over two consecutive years. In the first year McGraw's curriculum "Reveal" was used exclusively without ALEKS. In the second year ALEKS was incorporated as a supplemental tool in a math support class. The study incorporated a rigorous methodology, utilizing…
Read More
New Pub: LAxplore: An NLP-Based Tool for Distilling Learning Analytics and Learning Design Instruments out of Scientific Publications

New Pub: LAxplore: An NLP-Based Tool for Distilling Learning Analytics and Learning Design Instruments out of Scientific Publications

Artificial Intelligence, Conference, Conference, Learning Analytics, Learning Design, New Pub, Open access, Publication, Technical paper
Abstract: Each year, the amount of research publications is increasing. Staying on top of the state of the art is a pressing issue. The field of Learning Analytics (LA) is no exception, with the rise of digital education systems that are used broadly these days from K12 up to Higher Education. Keeping track of the advances in LA is challenging. This is especially the case for newcomers to the field, as well as for the increasing number of LA units that consult their teachers and scholars on applying evidence-based research outcomes in their lectures. To keep an overview of the rapidly growing research findings on LA, we developed LAxplore, a tool that uses NLP to extract relevant information from the LA literature. In this article, we present the evaluation of…
Read More
Conference: Paper presentation at IC3K 2023

Conference: Paper presentation at IC3K 2023

Artificial Intelligence, Conference, Conference, General education, Higher Education, Learning Analytics, Learning Design, New Pub, Publication, Technical paper
The purpose of the IC3K is to bring together researchers, engineers and practitioners on the areas of Knowledge Discovery, Knowledge Engineering and Knowledge Management. IC3K is composed of three co-located conferences (KDIR, KEOD and KMIS), each specialized in at least one of the aforementioned main knowledge areas. Our paper titled "LAxplore: An NLP-Based Tool for Distilling Learning Analytics and Learning Design Instruments out of Scientific Publications" was accepted at the 15th International Conference on Knowledge Discovery and Information Retrieval (KDIR). Atezaz Ahmad presented the paper at the conference online. ABSTRACT: Each year, the amount of research publications is increasing. Staying on top of the state of the art is a pressing issue. The field of Learning Analytics (LA) is no exception, with the rise of digital education systems that are…
Read More
Unveiling Gender Bias in Computer-Supported Collaborative Learning: Insights from a CS Hackathon Study

Unveiling Gender Bias in Computer-Supported Collaborative Learning: Insights from a CS Hackathon Study

Computer-supported collaborative learning, Digitalisation, Event, Gender, Higher Education, Journal, Learning Design, New Pub, Open access, Publication, Research topic
Gender stereotypes about women and men are prevalent in computer science (CS). The study's goal was to investigate the role of gender bias in computer-supported collaborative learning (CSCL), group work in a CS context, by elaborating on gendered experiences in the perception of individual and team performance in mixed-gender teams in a hackathon. We applied an exploratory mixed-method approach using quantitative survey data, including collective self-esteem scales, at several time points during the hackathon, which was analysed with clustering and descriptive statistics and complemented with qualitative coding of interviews with participants. The Figure shows that, for both clusters, the self-esteem scores are predominantly located in the upper half of the scale, indicating a generally high (collective) self-esteem among all our participants. Nonetheless, all respective scores were lower for the women-dominated…
Read More
New Pub: Social Presence and Psychological Distance

New Pub: Social Presence and Psychological Distance

Computer-supported collaborative learning, Empirical Study, Higher Education, Journal, Learning Design, New Pub, Publication
Social presence –the sense that others are 'real' and 'there'– is a key variable in understanding interpersonal dynamics in online learning environments. As students are separated in time and place, social cues are diminished and communication is affected. This is particularly relevant for social learning scenarios like computer-supported collaborative learning. Despite its relevance and decades of research, there are still many gaps in our understanding of social presence. In order to arrive at a more holistic understanding of social presence, it would be valuable to better understand how this experience fits within larger psychological frameworks. One particularly well-established psychological framework is Construal Level Theory by Trope & Liberman (2010). It posits that our mental representations of objects, events, and persons (i.e. construals) are affected by the psychological distance between us…
Read More