New research program: Towards Highly Informative Learning Analytics

New research program: Towards Highly Informative Learning Analytics

Artificial Intelligence, Assessment, Book, Computational Psychometrics, Computer-supported collaborative learning, Feedback, Further Education, Higher Education, Keynote, Learning Analytics, Learning Design, Research Methods, School
On May 12, 2023, the Highly Informative Learning Analytics (HILA) research program of the EduTec@DIPF, studiumdigitale@Goethe University Frankfurt and the Open Learning and Instruction group@Open Universiteit was presented by Hendrik Drachsler at the main campus of the Open University of the Netherlands. The release of the HILA research program marks a significant milestone for the collaboration in the field of learning analytics between of the Dutch-German research collective.  The HILA research program is focused on developing new tools and methods to collect, analyze, and interpret data that can help educational institutions to understand the learning process better. As part of the program's launch, a keynote by Ioana Jivet on student-facing learning analytics was provided. Ioana reported on two empirical studies investigating the effect of data-driven feedback on students. [pdf-embedder url="https://edutec.science/wp-content/uploads/2023/05/2023_05-Keynote-Symposium-Hendrik.pdf"…
Read More
HILA Keynote @ CEL annual meeting

HILA Keynote @ CEL annual meeting

Conference, Feedback, Higher Education, Invited talk, Keynote, Learning Analytics, Learning Design, Transfer Activity
Hendrik Drachsler gave a keynote @ the LDE CEL Annual Meeting under the theme ‘Developing a Culture of Learning Analytics'. Hendrik summarized the achievements of the Highly Informative and Learning Analytics (HILA) research program, that is the successor of the Trusted Learning Analytics research program conducted in Frankfurt, Germany.  After two years of digital annual meetings, finally CEL could invite again to their annual meeting 2022 at the CEL Teaching Lab. Among keynotes from Simon Buckingham Shum (University of Technology Sydney), and Alyssa Friend Wise (New York University), Hendrik presented the latest research outcomes on Highly Informative and Learning Analytics (HILA) research program. Highly informative and competency-based feedback is costly and can be best given in small teacher-to-learner settings. According to research, feedback has a powerful effect on learning success;…
Read More
New Pub: Untangling connections between challenges in the adoption of learning analytics in higher education

New Pub: Untangling connections between challenges in the adoption of learning analytics in higher education

Empirical Study, Higher Education, Journal, Learning Analytics, Publication
[caption id="attachment_4599" align="alignnone" width="967"] Associations of challenges and ethics: (a) none, (b) prep-partial, and (c) full adoption institutions[/caption] Potential benefits of learning analytics (LA) for improving students' performance, predicting students' success, and enhancing teaching and learning practice have increasingly been recognized in higher education. However, the adoption of LA in higher education institutions (HEIs) to date remains sporadic and predominantly small in scale due to several socio-technical challenges. To better understand why HEIs struggle to scale LA adoption, it is needed to untangle adoption challenges and their related factors. This paper presents the findings of a study that sought to investigate the associations of adoption factors with challenges HEIs face in the adoption of LA and how these associations are compared among HEIs at different scopes of adoption. The study…
Read More
New Pub: FoLA2 — A Method for Co-creating Learning Analytics–Supported Learning Design

New Pub: FoLA2 — A Method for Co-creating Learning Analytics–Supported Learning Design

Further Education, General education, Higher Education, Journal, Learning Analytics, Learning Design, Open access, Publication, School
Finally, we have published an article about the FOLA2 method that we have used for over two years frequently to design Learning Analytics supported Learning Designs with teachers of various backgrounds. Learning activities are at the core of every educational design effort. Designing learning activities is a process that benefits from reflecting on previous runs of those activities. One way to measure the behaviour and effects of design choices is to use learning analytics (LA). The challenge, however, lies in the unavailability of an easy-to-use, LA-supported learning design (LD) method. We established a method—the Fellowship of Learning Activities and Analytics (FoLA2)—reinforced by a gameboard and cards to provide structure and inspiration. The method enables several participants with different roles to interact with a set of card decks to create an…
Read More
New Pub: Toward learning progression analytics — Developing learning environments for the automated analysis of learning using evidence-centred design

New Pub: Toward learning progression analytics — Developing learning environments for the automated analysis of learning using evidence-centred design

Computational Psychometrics, Journal, Learning Analytics, Learning Design, Open access, Project, Publication, School
[caption id="attachment_4319" align="alignright" width="450"] A procedure for developing digital learning environments that allow for the automated assessment of learning.[/caption] National educational standards stress the importance of science and mathematics learning for today’s students. However, across disciplines, students frequently struggle to meet learning goals about core concepts like energy. Digital learning environments enhanced with artificial intelligence hold the promise to address this issue by providing individualized instruction and support for students at scale. Scaffolding and feedback, for example, are both most effective when tailored to students’ needs. Providing individualized instruction requires continuous assessment of students’ individual knowledge, abilities, and skills in a way that is meaningful for providing tailored support and planning further instruction. While continuously assessing individual students’ science and mathematics learning is challenging, intelligent tutoring systems show that it…
Read More
Transfer Workshop @ Digitaltag 2022 on highly informative and data-driven feedback with AI in higher education

Transfer Workshop @ Digitaltag 2022 on highly informative and data-driven feedback with AI in higher education

Artificial Intelligence, Conference, Event, Higher Education, Learning Analytics, Open access, School, Transfer Activity, Webinar, Workshop
The third Digitaltag will take place on June 24, 2022. The initiative "Digital for All" is behind the Digitaltag. The alliance of more than 25 organizations from the fields of civil society, culture, science, business, welfare and the public sector unites a common goal: to promote digital participation in Germany. Prof. Dr. Hendrik Drachsler contributes a talk on highly informative and data-driven feedback with AI in higher education. Feedback is a powerful element of all learning processes. However, it is difficult to offer highly informative feedback to large groups of learners. The Educational Technology Collective at Goethe University and the DIPF Leibniz Institute Frankfurt am Main are conducting research on this challenge in a variety of projects. In this talk, Professor Dr. Drachsler will present on designing highly informative feedback…
Read More
Keynote at LERN Jahrestagung 2022

Keynote at LERN Jahrestagung 2022

Computational Psychometrics, Higher Education, Invited talk, Keynote, Learning Analytics, Learning Design, School
On 30 March 2022, Hendrik Drachsler gave an invited keynote at the LERN conference 2022 where he reported on the latest research on data-driven high informative feedback in higher education and schools. The talk focused on the experience of edutec.science research collective that has been gained in the projects DIFA, HIKOF-DL, AFLEK and ALICE. The presentation provided an overview of actionable and supportive feedback to learners as well as the various technical products that the EduTec group has developed. It, therefore, applies web technology to support meta-cognitive and collaborative learning skills with high-informative feedback methods. Hendrik applies validated measurement instruments from the field of psychometrics and investigates to what extent Learning Analytics interventions can reproduce the findings of these instruments. He discussed the lessons learned from implementing TLA systems. He…
Read More
New Pub: Chapter in Learning Analytics Handbook 2022

New Pub: Chapter in Learning Analytics Handbook 2022

Higher Education, Learning Analytics
More and more higher education institutions have been making use of learning analytics in the last few years. But despite an increased funding and more research in the learning analytics domain, there is still a lack of systematic and large-scale implementations of learning analytics. In order to improve learning analytics adoption and to establish it sustainably, higher education institutions need to align learning analytics-related activities with their goals and visions. Their making us of data requires a set of guidelines and principles, i.e. a policy, that fits their context and speaks to all involved stakeholders. Only then can the effective and responsible use of learning analytics be ensured and will higher education institutions be truly able to establish learning analytics in a sustainable way. Reference: Scheffel, M., Tsai, Y.-S., Gašević,…
Read More
New Pub: Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration Analytics

New Pub: Towards Collaborative Convergence: Quantifying Collaboration Quality with Automated Co-located Collaboration Analytics

Conference, Conference, Event, Higher Education, Learning Design, Multimodal Learning Analytics, Publication
Collaboration is one of the four important 21st-century skills. With the pervasive use of sensors, interest on co-located collaboration (CC) has increased lately. Most related literature used the audio modality to detect indicators of collaboration (such as total speaking time and turn taking). CC takes place in physical spaces where group members share their social (i.e., non-verbal audio indicators like speaking time, gestures) and epistemic space (i.e., verbal audio indicators like the content of the conversation). Past literature has mostly focused on the social space to detect the quality of collaboration. In this study, we focus on both social and epistemic space with an emphasis on the epistemic space to understand different evolving collaboration patterns and collaborative convergence and quantify collaboration quality. We conduct field trials by collecting audio recordings…
Read More
PhD defense: Measuring the Unmeasurable? Towards Automatic Co-located Collaboration Analytics

PhD defense: Measuring the Unmeasurable? Towards Automatic Co-located Collaboration Analytics

Artificial Intelligence, Book, Higher Education, Learning Analytics, Multimodal Learning Analytics, PhD defense, Press
Collaboration is one of the most important skills in the 21st century. Education, therefore, focuses on learning to cooperate, both in online and face-to-face settings. Learning Analytics is increasingly being used to analyse collaborations. Can face-to-face collaborations be analysed automatically by means of sensor technology? And what is the quality of the analyses generated by this? Sambit Praharaj developed a technical prototype to achieve automated collaboration analytics. On Friday 11 March 2022 at 1.30 pm Sambit defended his thesis 'Measuring the Unmeasurable? Towards Automatic Co-located Collaboration Analytics' at the Open University in Heerlen. Collaboration analytics using sensor technology Sambit Praharaj investigated the possibilities of automating collaboration analytics in face-to-face settings. He developed a prototype that measures the quality of collaboration. Praharaj also developed a dashboard that visualises the data and…
Read More