News

GREAT project presentation at World Forum Women in Science – Theme “Science for the SDGs”

GREAT project presentation at World Forum Women in Science – Theme “Science for the SDGs”

Event, Invited talk
On 15 April, GREAT project manager Dr. Jane Yau had the pleasure of moderating the session Technology, Sustainability and Industry with Prof. Nova Ahmed at the World Forum Women in Science - Theme: Science for the SDGs (https://women-in-science-without-borders.network/world-forum-women-in-science-2024/).  The session included a number of initiatives of empowering women and underrepresented groups to take on science activities and careers to advance the SDGs. Jane also shared the GREAT project findings in this session with a talk “Gaming for Change: Leveraging digital games to address climate change”, based on the GREAT project methodology and first case study findings!  The session was free to attend and was live-streamed on Facebook. The video recording will be available shortly.Jane will also be in Rome, Italy, on 19 April to attend the in-person Networking Event as…
Read More
New Pub: Feedback sources in essay writing: peer-generated or AI-generated feedback?

New Pub: Feedback sources in essay writing: peer-generated or AI-generated feedback?

Artificial Intelligence, Empirical Study, Feedback, Further Education, Journal, Publication
A newly published article discusses the use of peer feedback as a learning strategy, particularly in large classes where teachers face heavy workloads. For complex tasks like writing argumentative essays, peers may struggle to provide high-quality feedback due to the cognitive demands involved. The emergence of Artificial Intelligence (AI) tools, like ChatGPT, raises the question of whether AI can serve as a new feedback source for such tasks. To investigate this, a study compared ChatGPT-generated feedback with peer feedback on argumentative essays written by 74 graduate students from a Dutch university. The study collected essay data, peer feedback and ChatGPT-generated feedback, and then analyzed them using coding schemes. Results showed significant differences between ChatGPT and peer feedback, with ChatGPT offering more descriptive feedback while peers focused on identifying essay problems.…
Read More
New Publication: Addressing gender in STEM classrooms: The impact of gender bias on women scientists’ experiences in higher education careers in Germany

New Publication: Addressing gender in STEM classrooms: The impact of gender bias on women scientists’ experiences in higher education careers in Germany

New Pub
 In an expert study conducted in Germany, Dana Kube and her research team delve into the complex dynamics of gender bias within STEM (Science, Technology, Engineering, and Mathematics) classrooms. The study, aimed at understanding the role gender plays in shaping the experiences of women scientists in higher education, sheds light on the challenges they face and proposes strategies for fostering gender inclusivity in STEM classrooms. The primary objective of the study was two-fold: first, to comprehensively examine the influence of gender and gender bias in STEM environments within higher education institutions, and second, to identify potential areas where Computer-Supported Collaborative Learning (CSCL) pedagogical interventions could mitigate these biases among students and teachers in German STEM departments. Employing the innovative group concept mapping method, the research team collaborated with women participants…
Read More
Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Artificial Intelligence, Assessment, Award, Computational Psychometrics, Conference, Higher Education, New Pub, Workshop
For standardized exams to be fair and reliable, they must include a diverse range of question difficulties to accurately assess test taker abilities. Additionally, it's crucial to balance the time allotted per question to avoid making the test unnecessarily rushed or sluggish. The goal of this year's BEA shared task (competition) was to build systems which could predict Item Difficulty and Item Response Time for items taken from the United States Medical Licensing Examination (USMLE). EduTec member Sebastian Gombert designed systems which are able to predict both variables simultaneously. These placed first out of 43 for predicting Item Difficulty and fitfth out of 34 for predicting Item Response Time. They use modified versions of established transformer language models in a multitask setup. A corresponding system description paper titled Predicting Item…
Read More
CORE Roundtable in Munich

CORE Roundtable in Munich

Assessment, Critical Online Reasoning, Multimodal Learning Analytics, Project, Project meeting
Hendrik Drachsler, Sebastian Gombert and Gianluca Romano participated at the Roundtable in Munich for the CORE project (Critical Online Reasoning in Higher Education) from 04.03.-05.03.2024. In those two days, our team had the chance to recapitulate on how the infrastructure stood strong during the first survey from December 2023 to February 2024, and pave the way for next steps and surveys. In summary, the infrastructure performed well. It dealt with approximately 10Mio. requests per seconds and the majority of hurdles participants reported were out of our authority. Requests from participants were dealt with quickly in a few days on average. Even though we are proud of our achievements there is still a lot to be done for future surveys. For the agenda we split into smaller groups, each of us…
Read More
Interview in Zeit Online: Cell Phone Bans in Schools

Interview in Zeit Online: Cell Phone Bans in Schools

Digitalisation, Press, School
In an interview with Zeit Online, Hendrik Drachsler explains his views on digitalization and cell phone bans in schools. He outlines that the hurdles associated with digitalization should be taken seriously, but that he is also very critical of extreme demands such as a complete ban on digitalization in schools. In his eyes it is important to differentiate between the usage of private devices and devices provided by the schools. Studies show that the use of private devices during the school day can distract students from learning and lower their concentration rates, for example during the private consummation of social media. On the other hand, the usage of tablets and AI during class can bring added value to the teaching process, especially while teaching complex concepts and with the individualization…
Read More
Didacta Presentation in Cologne: Key Questions to Find Fitting AI Solutions For Student Feedback

Didacta Presentation in Cologne: Key Questions to Find Fitting AI Solutions For Student Feedback

Artificial Intelligence, Feedback, General education, Invited talk, School
What are the goals of AI in education for student feedback? How can teachers make sure that their AI-assisted feedback goes beyond simple right/wrong statements and instead provides not only correct solutions, but also possibilities for improvement, hints on competence development and effective learning strategies? To find a fitting AI solution, there are key questions one should know to ask in advance. These questions were outlined by Hendrik Drachsler in his presentation at the didacta 2024 in Cologne on 20.02.2024 titled “Ihr KI-Anbieter-Test - 3 Schlüsselfragen die Sie kennen sollten.” The key questions: Question 1: What indicators does your AI product use to analyze learning outcomes? --> Look for AI products that provide relevant indicators for measuring learning progress and skills acquisition. These indicators are important to accurately assess learning…
Read More
Podcast “Sitzenbleiben” About AI in Education

Podcast “Sitzenbleiben” About AI in Education

Artificial Intelligence, General education, School
In a special edition of the DIPF podcast "Sitzenbleiben", Kai Maaz (Executive Director of DIPF) and Hendrik Drachsler discuss the potentials and hurdles of integrating artificial intelligence (AI) into education. The conversation surrounding AI's capabilities and constraints has been rapidly gaining traction. Especially the emergence of large language models like ChatGPT has revolutionized the text creation process, which showcase the vast opportunities that AI technologies can bring to the education sector. Questions abound regarding AI's impact on education: How can AI impact tasks such as homework or exams? How can AI enrich lessons? Which data protection issues need to be considered? How can students and educators receive adequate support in navigating AI's integration into learning environments? These questions serve as focal points which are examined in this newly available podcast…
Read More
Celebrating Ioana Jivet’s New Adventure at Catalpa: A Farewell and Congratulations

Celebrating Ioana Jivet’s New Adventure at Catalpa: A Farewell and Congratulations

Alumni, Team
In the midst of our busy lives between scholarly discourse and the clatter of keyboards, there are moments that stand out, moments of transition and reflection. In this blog post today, we bid farewell to a cherished colleague, Dr. Ioana Jivet, as she embarks on a new chapter of her journey as a Professor at CATALPA - Center of Advanced Technology for Assisted Learning and Predictive Analytics at the FernUniversität in Hagen. For nearly a decade, Ioana has been an integral part of our team, bringing not only her expertise but also her warmth and dedication. As analytics scientists we like diving into the numbers: from the start of Ioana’s time with us on June 1, 2021, until her your new start at CATALPA on March 1st, 2024, we've had…
Read More
New Pub: AI program doesn’t make kids better at math, but it makes them more independent

New Pub: AI program doesn’t make kids better at math, but it makes them more independent

Assessment, Journal, Publication, School
Students who receive math tutoring from an artificial intelligence (AI) program perform no better than students who are taught by a "real" teacher. These students do, however, need less help learning. This is the conclusion of Rashmi Khazanchi from the Open University of the Netherlands together with Hendrik Drachsler and Daniele Di Mitri. Math Lessons with AI The researchers examined the effectiveness of the Assessment and Learning in Knowledge Spaces (ALEKS) tutoring program, called Intelligent Tutoring Systems (ITS). Previous studies have shown that students learn math better using software than traditional teaching methods. Previous studies on ALEKS have also shown that, thanks to this program, students memorize more knowledge, perform better, experience more engagement in mathematics and drop out less. The advantage of an ITS like ALEKS is that it…
Read More