News

New pub: Causal reasoning with causal graphs, published in ETRD

New pub: Causal reasoning with causal graphs, published in ETRD

Journal, Publication, Research Methods, Special Issue
Educational Technology, like many other empirical research fields, needs to provide evidence for the causal effectiveness of their interventions. This is as important for establishing the efficacy of some novel educational technology as it is for theory-building. However, because educational research, especially field research, can be messy, tightly-controlled randomized experiments are not always the best option. Importantly, as our development paper shows, this does not mean that researchers should abandon all claims of causality. Instead, we highlight the importance of explicit causal reasoning, while equipping researchers with a tool to approach this daunting task systematically. Causal graphs (or Directed Acyclic Graphs = DAGs) are a low-barrier approach to reasoning about causality in all research contexts. Using a few construction rules, the resultant graphs allow researchers to figure out whether a…
Read More
New research program: Towards Highly Informative Learning Analytics

New research program: Towards Highly Informative Learning Analytics

Artificial Intelligence, Assessment, Book, Computational Psychometrics, Computer-supported collaborative learning, Feedback, Further Education, Higher Education, Keynote, Learning Analytics, Learning Design, Research Methods, School
On May 12, 2023, the Highly Informative Learning Analytics (HILA) research program of the EduTec@DIPF, studiumdigitale@Goethe University Frankfurt and the Open Learning and Instruction group@Open Universiteit was presented by Hendrik Drachsler at the main campus of the Open University of the Netherlands. The release of the HILA research program marks a significant milestone for the collaboration in the field of learning analytics between of the Dutch-German research collective.  The HILA research program is focused on developing new tools and methods to collect, analyze, and interpret data that can help educational institutions to understand the learning process better. As part of the program's launch, a keynote by Ioana Jivet on student-facing learning analytics was provided. Ioana reported on two empirical studies investigating the effect of data-driven feedback on students. [pdf-embedder url="https://edutec.science/wp-content/uploads/2023/05/2023_05-Keynote-Symposium-Hendrik.pdf"…
Read More
New Pub: A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards

New Pub: A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards

Journal, Learning Analytics, Publication
Higher education institutions are moving to design and implement teacher-facing learning analytics (LA) dashboards with the hope that instructors can extract deep insights about student learning and make informed decisions to improve their teaching. While much attention has been paid to developing teacher-facing dashboards, less is known about how they are designed, implemented and evaluated. This paper presents a systematic literature review of existing studies reporting on teacher-facing LA dashboards. Out of the 1968 articles retrieved from several databases, 50 articles were included in the final analysis. Guided by several frameworks, articles were coded based on the following dimensions: purpose, theoretical grounding, stakeholder involvement, ethics and privacy, design, implementation, and evaluation criteria. The findings show that most dashboards are designed to increase teachers’ awareness but with limited actionable insights to…
Read More
HIKOF-DL Presentation at the University Future Festival

HIKOF-DL Presentation at the University Future Festival

Conference, Event
  Jane, as the project-coordinator, presented HIKOF-DL in the Track - AI & Technology, at the University Future Festival on 27.4.2023. Abstract: During the COVID-19 pandemic, we made use of artificial intelligence and learning analytics technologies for both lecturers’ and students’ online teaching and learning gains. Using these technologies, the team designed and implemented novel ways of providing highly-informative competence driven feedback (hicof) to large classes of university students (≈1000) for three innovative online assignments. We built machine learning models to automatically assess the assignments and reduced the time required for staff to manually grade them. High-informative feedback provides correct solutions, possibilities for improvement, hints on self-regulation and effective learning strategies (Wisniewski, Zierer and Hattie, 2020; Winne & Hadwin, 2008), and on two different levels - Feed Up (concerning their understanding of the learning goal) and Feed Forward (concerning their next steps in their learning process) (Hattie & Timberley, 2007). Competence driven feedback is feedback that is given to students based on…
Read More
HIKOF-DL – 4th Committee Meeting with Industry Members

HIKOF-DL – 4th Committee Meeting with Industry Members

Event, Transfer Activity
The fourth Committee meeting with industry members of the research project "HIKOF-DL" took place on March 31, 2023. HIKOF-DL is a project funded by the Hessen Ministerium für Digital Strategie und Entwicklung, which aims to provide high-informative feedback for a large number of university students, and automatic assessment, in order to reduce the lecturers' workload. The meeting yielded exciting results and discussions, showcasing the progress and potential of this innovative study. The meeting kicked off with an introduction by Prof. Dr. Hendrik Drachsler, who emphasized the significance of artificial intelligence (AI) in education. Dr. Joshua Weidlich, a key researcher in the project, then presented the research design of the study. The study population was divided into an experimental group and a control group to investigate two aspects: how students respond…
Read More
CORE: New project investigates students’ critical use of digital media

CORE: New project investigates students’ critical use of digital media

Assessment, Digitalisation, Higher Education, Project, Research topic, Target group
Students are increasingly using information from the Internet to learn for their studies. According to recent surveys, they even cite the Internet as their main source when searching for learning materials. Research shows that students often rely on inappropriate, irrelevant and scientifically unsupported sources when searching the web. Little is known about exactly how self-directed learning takes place on the Internet and how information is selected and processed. This will now be addressed by the new research group "Kritisches Denken in Online-Lernumgebungen in der Hochschulbildung (CORE)” (Critical Thinking in Online Learning Environments in Higher Education), which is being funded by the German Research Foundation (DFG) with more than 5 million euros over the next four years. The CORE project will investigate the critical use of digital media and information among…
Read More
Visit from Sasha Poquet

Visit from Sasha Poquet

Digitalisation, Higher Education, Invited talk, Learning Analytics, Research topic
On April 13th, we had the pleasure of welcoming Prof. Dr. Oleksandra (Sasha) Poquet, professor in learning analytics at the TUM School of Social Sciences and Technology at the Technical University of Munich, to our EduTec group in Frankfurt. The visit provided a valuable opportunity for the EduTec group to learn from Sasha's research experience and explore the future of educational technology. The visit began with an introduction by Hendrik Drachsler, who provided an overview of our current research and ongoing projects. This was followed by a presentation by Oleksandra Poquet, who discussed her current, present and future research. In the past, Sasha's research focused on Massive Open Online Courses (MOOCs) and the impact of homophily on university course enrollment. She also discussed her work on Modelling Digital Networks with…
Read More
Paper and presentation about the topic of detecting disengaged reading at LAK23

Paper and presentation about the topic of detecting disengaged reading at LAK23

Conference, Conference, Event, Higher Education, Publication, Research topic, Self-Regulation, Target group
At the recent Learning Analytics and Knowledge Conference (LAK23), Daniel Biedermann presented his paper "Detecting the Disengaged Reader - Using Scrolling Data to Predict Disengagement during Reading," to shed light on the potential for early detection of disengagement in readers. The paper presents a unique method for early disengagement detection that relies solely on the classification of scrolling data. By transforming scrolling data into a time series representation, each point of the series represents the vertical position of the viewport in the text document. Time series classification algorithms are then used to evaluate the data.The results were promising, with the method able to classify disengagement early with up to 70% accuracy. However, the study also observed differences in performance depending on which texts were included in the training dataset. Biedermann…
Read More
Reelection in the Executive Committee of SoLAR

Reelection in the Executive Committee of SoLAR

Learning Analytics, Team
Ioana Jivet has been reelected to the Executive Committee of the Society for Learning Analytics Research (SoLAR) for another mandate of two years 2023-2025. The Executive committee governs the society's work and meets regularly to decide on matters of policy, general business, the tabling of reports from any Committee and any other matter that requires the Executive’s decision-making powers. The Society for Learning Analytics Research (SoLAR) is an inter-disciplinary network of leading international researchers who are exploring the role and impact of analytics on teaching, learning, training and development. SoLAR has been active in organizing the International Conference on Learning Analytics & Knowledge (LAK) and the Learning Analytics Summer Institute (LASI), launching multiple initiatives to support collaborative and open research around learning analytics, promoting the publication and dissemination of learning analytics research, and advising and…
Read More
Highly Informative LA Workshop at LAK23

Highly Informative LA Workshop at LAK23

Conference, Higher Education, Learning Analytics, Learning Design, Workshop
On the 13th of March 2023, as part of the LAK23 conference, five EduTec team members (Daniele Di Mitri, Ioana Jivet, Sebastian Gombert, Atezaz Ahmad and Hendrik Drachsler) organised a full-day workshop on Highly Informative Learning Analytics with Marcel Schmitz from Zuyd University of Applied Sciences, The Netherlands. In this workshop, we investigated the concept of highly informative learning analytics and proposed a methodology for designing an environment that delivers highly informative learning analytics. The workshop is intended as a hands-on, interactive session that allows participants to test the methodology’s potential in a realistic use case. The proposed approach is based on the four-stage process of the Design Cycle for Education (DC4E). We exemplify practical tools that were designed in-house for each stage, including a tool to support teachers while…
Read More