Computational Psychometrics

Jun22023 by Heather WehnerNo Comments

New pub: Digitalisierung und Diagnostik in Schulen – Herausforderungen für Bildungspraxis und Bildungsforschung

Assessment, Book chapter, Computational Psychometrics, Digitalisation, Learning Analytics, Publication, Research Methods, Research topic, School, Target group

In the spring of 2020, schools faced an unprecedented challenge as the pandemic disrupted traditional modes of instruction and school development. With on-site learning replaced by digital formats and distance communication, educators had to quickly adapt to the new normal. Amidst these changes, the field of education encountered specific challenges related to digital school management, digital learning, and assessing learning progress. Particularly, computer-aided diagnostics emerged as a valuable tool for gaining insights not only into learning outcomes but also into the learning process itself. Researchers became intrigued by the potential of digital media in shaping learning experiences and how the resulting data could be effectively utilized in educational practice. This paper explores the current challenges and potentials in computer-based, learning-accompanying diagnostics. The primary hurdles involve implementing suitable instruments within schools…

May152023 by Prof. Dr. Hendrik DrachslerNo Comments

New research program: Towards Highly Informative Learning Analytics

Artificial Intelligence, Assessment, Book, Computational Psychometrics, Computer-supported collaborative learning, Feedback, Further Education, Higher Education, Keynote, Learning Analytics, Learning Design, Research Methods, School

On May 12, 2023, the Highly Informative Learning Analytics (HILA) research program of the EduTec@DIPF, studiumdigitale@Goethe University Frankfurt and the Open Learning and Instruction group@Open Universiteit was presented by Hendrik Drachsler at the main campus of the Open University of the Netherlands. The release of the HILA research program marks a significant milestone for the collaboration in the field of learning analytics between of the Dutch-German research collective. The HILA research program is focused on developing new tools and methods to collect, analyze, and interpret data that can help educational institutions to understand the learning process better. As part of the program's launch, a keynote by Ioana Jivet on student-facing learning analytics was provided. Ioana reported on two empirical studies investigating the effect of data-driven feedback on students. [pdf-embedder url="https://edutec.science/wp-content/uploads/2023/05/2023_05-Keynote-Symposium-Hendrik.pdf"…

Aug262022 by Prof. Dr. Hendrik DrachslerNo Comments

New Pub: Toward learning progression analytics — Developing learning environments for the automated analysis of learning using evidence-centred design

Computational Psychometrics, Journal, Learning Analytics, Learning Design, Open access, Project, Publication, School

[caption id="attachment_4319" align="alignright" width="450"] A procedure for developing digital learning environments that allow for the automated assessment of learning.[/caption] National educational standards stress the importance of science and mathematics learning for today’s students. However, across disciplines, students frequently struggle to meet learning goals about core concepts like energy. Digital learning environments enhanced with artificial intelligence hold the promise to address this issue by providing individualized instruction and support for students at scale. Scaffolding and feedback, for example, are both most effective when tailored to students’ needs. Providing individualized instruction requires continuous assessment of students’ individual knowledge, abilities, and skills in a way that is meaningful for providing tailored support and planning further instruction. While continuously assessing individual students’ science and mathematics learning is challenging, intelligent tutoring systems show that it…

Mar302022 by Prof. Dr. Hendrik DrachslerNo Comments

Keynote at LERN Jahrestagung 2022

Computational Psychometrics, Higher Education, Invited talk, Keynote, Learning Analytics, Learning Design, School

On 30 March 2022, Hendrik Drachsler gave an invited keynote at the LERN conference 2022 where he reported on the latest research on data-driven high informative feedback in higher education and schools. The talk focused on the experience of edutec.science research collective that has been gained in the projects DIFA, HIKOF-DL, AFLEK and ALICE. The presentation provided an overview of actionable and supportive feedback to learners as well as the various technical products that the EduTec group has developed. It, therefore, applies web technology to support meta-cognitive and collaborative learning skills with high-informative feedback methods. Hendrik applies validated measurement instruments from the field of psychometrics and investigates to what extent Learning Analytics interventions can reproduce the findings of these instruments. He discussed the lessons learned from implementing TLA systems. He…

Jan252022 by Sebastian GombertNo Comments

Team of EduTec and TBA Members Wins Runners-Up Prize @ NAEP Reading Automated Scoring Challenge

Artificial Intelligence, Assessment, Award, Computational Psychometrics, School

The NAEP Reading Automated Scoring Challenge was a competition which was held in late 2021 by the National Center for Education (USA). The goal was to evaluate the applicability of natural language processing methodology to the task of scoring of large scale constructed response assessment data. In addition to this, participating models were also required to be interpretable and free of algorithmic bias against different student demographics. The data set which was used to evaluate the systems consisted of responses from 4th and 8th grade school student to 20 different reading comprehension tasks. More than a dozen different teams from universities and private assessment companies submitted contributions. Out of these, 12 contributions, including ours, were selected as eligible with respect to interpretability and algorithmic fairness. These contributions were then ranked…

Jul62021 by Prof. Dr. Hendrik DrachslerNo Comments

SoLAR webinar on: Investigating persistent and new challenges of learning analytics

Artificial Intelligence, Computational Psychometrics, Higher Education, Keynote, Learning Analytics, Learning Design, Multimodal Learning Analytics, School, Workshop

On 29 June 2021, Hendrik Drachsler gave an invited webinar for the SoLAR webinar channel where he reflected the process of applying learning analytics solutions within higher education settings and schools, its implications, and the critical lessons learned in the Trusted Learning Research Program. The talk focused on the experience of edutec.science research collective consisting of researchers from the Netherlands and Germany that contribute to the Trusted Learning Analytics (TLA) research program. The TLA program aims to provide actionable and supportive feedback to students and stands in the tradition of human-centred learning analytics concepts. It, therefore, applies sensor technology to support psychomotor as well as web technology to support meta-cognitive and collaborative learning skills with high-informative feedback methods. Hendrik applies validated measurement instruments from the field of psychometric and investigates…

Jun12021 by Prof. Dr. Hendrik DrachslerNo Comments

Kickoff Meeting of HICOF-DL – Highly Informative and Competence-based Feedback for Digital Learning

Computational Psychometrics, Higher Education, Learning Analytics, Project

Currently, almost all students learn only digitally at home, because in the wake of the COVID 19 pandemic, universities have largely converted their teaching to online courses. But the virtual lectures and seminars often still lack individual feedback for learners. A new project conducted by the DIPF | Leibniz Institute for Human Development and Educational Information and the Goethe University Frankfurt aims to change that. The researchers want to develop a software tool that uses modern, automated evaluation methods to help provide accurate feedback. Derzeit lernen fast alle Studierenden nur digital zu Hause, denn im Zuge der COVID-19-Pandemie haben die Hochschulen ihren Lehrbetrieb größtenteils auf Online-Veranstaltungen umgestellt. Doch den virtuellen Vorlesungen und Seminaren mangelt es häufig noch an individuellen Rückmeldungen für die Lernenden. Ein neues, vom DIPF | Leibniz-Institut für…

Jun12021 by Daniele Di MitriNo Comments

Jane Yau joins the team

Computational Psychometrics, Learning Analytics, Team

Starting 1st June 2021, Dr. Jane Yau joins the EduTec team as a Researcher in the HIKOF-DL project. This project combines the existing methods from two open-source software tools – personalisation of formative learning feedback with the OnTask tool (funded by the Australian Govt.) and transformation of generic tests into adaptive ones suiting to individual learner profiles with the KAT-HS tool (funded by BMBF, Germany) in order to form new technologies for improving teaching and learning in the university context. This new feedback system will be implemented and evaluated with students at the Goethe University in Frankfurt and further collaborations with industry partners will be developed, who are interested in the technologies for increasing the learning effectiveness and study success within their students’ courses. In Jane’s Masters thesis, she focused…

Apr62021 by Joshua WeidlichNo Comments

Joshua Weidlich joins the team

Computational Psychometrics, Learning Design, Team

Starting April 2021, Joshua Weidlich joins the team as PostDoctoral researcher. He completed his PhD on social presence in online learning environments at the FernUniversität in Hagen in February 2021. He holds a Master's Degree in E-Learning and Media Education from Heidelberg University of Education as well as a Bachelor's Degree in Educational Science from Chemnitz University of Technology. See profile page for more information.