New Pub: The Student Feedback Literacy Instrument (SFLI)

New Pub: The Student Feedback Literacy Instrument (SFLI)

Feedback, Further Education, Journal, New Pub
In the context of higher education, feedback plays an especially important role in the learning process. For students it is not only important to receive feedback, but also to be able to understand and process this feedback in a manner which helps them make learning progress. The knowledge, skills and attitudes students need to navigate the feedback process successfully are referred to as feedback literacy. A recently published study presents a refined version of the Student Feedback Literacy Instrument (SFLI), which offers a powerful tool to measure feedback literacy construct across multiple languages and cultures. The SFLI aims to measure feedback literacy across two key dimensions: feedback attitudes and feedback practices. The full-length version of the instrument was recently refined and tested, alongside a short-form version (SFLI-S), in a multilingual…
Read More
Guest Talk at Monash University

Guest Talk at Monash University

Feedback, Invited talk
During his recent research visit to Australia, Daniele Di Mitri had the privilege of presenting at Monash University, specifically at the Centre for Learning Analytics Monash (COLAM). His talk, titled “The Quest for Automated Feedback,” explored the evolving role of AI in education, particularly in providing meaningful feedback to students. As generative AI tools like ChatGPT become increasingly popular among students seeking feedback on their essays, a critical question arises: How effective is this feedback? Daniele's research delves into the complexities of generating automated feedback, emphasising that it is not a one-size-fits-all solution. Feedback is inherently context-dependent, influenced by various factors, including the learner’s needs, the task at hand, and the feedback modality. The literature on feedback is vast and nuanced. Daniele referenced several foundational models, including Hattie & Timperley (2007) and…
Read More
New Pub: Conceptual Map Assessment Through Structure Classification

New Pub: Conceptual Map Assessment Through Structure Classification

Assessment, Conference, Feedback, Publication, School
In educational settings concept maps are often chosen as a tool to help knowledge constructions be visualized. While mapping out concepts and their relationships, students are able to show how well (or not well) they understand certain subjects. A newly published study, which was presented at the AIED 2024 in Recife, Brazil, takes their usage a step further, examining the structural patterns in concept maps and developing an automated system to classify them. The researchers categorized 511 different concept maps into three key structures: spoke, network and chain. Each structure type can provide its own insight about the deepness of students’ understanding. For example, a "spoke" structure may indicate a surface-level understanding, while a "network" might reflect a more complex comprehension. The researchers trained multiclass classification models using statistical data…
Read More
Exploring Complexity in Human Learning at the Johanna Quandt Young Academy School

Exploring Complexity in Human Learning at the Johanna Quandt Young Academy School

Feedback, Invited talk
On Monday, 7th October 2024, Dr. Daniele Di Mitri had the pleasure of presenting at the Johanna Quandt Young Academy School, held at the Forschungskolleg Humanwissenschaften in Bad Homburg. This event was a fantastic opportunity to delve into the intricate topic of "Complexity in Human Learning" alongside Dr. Elena Galeano Weber. Dr. Di Mitri's segment of the presentation focused on "Supporting Learning with AI through Feedback." He explored the multifaceted nature of complexity in human learning and discussed the critical aspects to consider when designing meaningful AI-automated feedback. The goal was to highlight how AI can be leveraged to enhance learning experiences by providing timely and relevant feedback, thus supporting learners in navigating complex educational landscapes. Understanding complexity in human learning is crucial for developing effective educational tools and strategies.…
Read More
HILA goes to school – Keynote at ISDT24, Linnaeus University, Sweden

HILA goes to school – Keynote at ISDT24, Linnaeus University, Sweden

Artificial Intelligence, Conference, Feedback, Keynote, Learning Analytics, School
What happens when Highly-Informative Learning Analytics (HILA) goes to school? That’s exactly what Hendrik Drachsler explored during his keynote at the 3rd International Symposium on Digital Transformation (ISDT24) in Linnaeus University Växjö, Sweden. His talk highlighted the impact of the AFLEK project, a transformative initiative under the HILA research program, which focuses on improving learning outcomes in secondary schools through actionable data and AI-driven tools. The keynote wasn't just about theoretical advances; it presented real-world applications that are actively shaping how secondary education functions today. Through three key publications, Drachsler demonstrated how the integration of Data-Enriched Learning Activities (DeLA), teacher dashboards, and empirical research has paved the way for improved teaching practices and measurable student success. Let’s dive into what happens when HILA meets the classroom. Key Highlights from Hendrik…
Read More
Advancing Automated Analysis of Concept Maps at AIED24

Advancing Automated Analysis of Concept Maps at AIED24

Artificial Intelligence, Feedback, Higher Education, Learning Analytics, Publication, School, Workshop, Workshop
The 25th International Conference on Artificial Intelligence in Education (AIED 2024), held from July 8-12 in Recife, Brazil, was a significant event for the Highly Informative Learning Analytics Research Programme. This year marked the first Brazilian-German cooperation in this field, supported by the Alexander Humboldt Foundation, the DIPF in Frankfurt and IPN in Kiel under the ALICE project. Two workshop papers presented at the conference showcased innovative approaches to automatically analyze concept maps, promising to automate the way educators assess and understand the student-created context. #AIED24 #LearningAnalytics #ConceptMaps #AIinEducation #EducationalTechnology #MachineLearning #CulturalDiversity #RealTimeFeedback #EdTech #AI #Education #CrossCulturalCollaboration Paper 1: The Influence of Diverse Educational Contexts on Concept Map Structures Authors: Laís P. Van Vossen, Isabela Gasparini, Elaine H. T. Oliveira, Berrit Czinczel, Ute Harms, Lukas Menzel, Sebastian Gombert, Knut Neumann,…
Read More
New pub: Potentials and Challenges of Generative AI in Instruction and Research on Instruction

New pub: Potentials and Challenges of Generative AI in Instruction and Research on Instruction

Artificial Intelligence, Feedback, General education, Journal, New Pub, School
Artificial Intelligence (AI) is becoming such a part of our daily lives that soon it will be almost impossible to imagine life without it. Especially since the emergence of ChatGPT and other Large Language Models, endless new possibilities have arisen for the usage of AI in many areas, especially in educational settings. Currently, the effective use of AI in education, both in teaching and learning, remains largely undefined, as do its limitations. We are also missing clarity regarding the potential benefits of AI for instructional research and the ethical boundaries of its use in this field. The opportunities and challenges associated with integrating AI into educational practices and research are explored in a newly published article from Hendrik Drachsler, Knut Neumann and Jochen Kuhn. In their paper they identify specific…
Read More
New Pub: Emotional and motivational effects of automated and personalized feedback

New Pub: Emotional and motivational effects of automated and personalized feedback

Computer-supported collaborative learning, Empirical Study, Feedback, Higher Education, Journal, Learning Analytics, New Pub, Open access
With increasingly large student numbers, providing personalized teacher feedback becomes untenable. On the other hand, providing students feedback about their work is an integral part of ensuring student support throughout their learning trajectory. Fortunately, Learning Analytics now makes it feasible to automatically deploy feedback to many students at once. However, the design of effective feedback still remains an area of investigation Joshua Weidlich, Aron Fink, Ioana Jivet, Jane Yau, Tornike Giorgashvili, Hendrik Drachsler, and Andreas Frey's recently published paper in the Journal of Computer-Assisted Learning focused on one key design feature: the reference frame. Any feedback content must be formulated in reference to some performance level, be it the average of the student group (social comparison), the desired performance level (criterion-referenced comparison), or past performance. A longstanding literature on this…
Read More
FoLA supports Simulation-based Training for High-risk Clinical Situations

FoLA supports Simulation-based Training for High-risk Clinical Situations

Assessment, Empirical Study, Feedback, Further Education, Higher Education, Learning Analytics, Learning Design, medical education, Multimodal Learning Analytics, Workshop
From May 16th to 17th, 2024, Hendrik Drachsler and Marcel Schmitz (TETRA AI, ZUYD University of Applied Science) had the pleasure of providing a FoLA workshop at the College of Anaesthesiologists of Ireland (CAI) in Dublin, Ireland, under the support of the Insight research centre. Together with members from CAI and from the ASSERT Centre, College of Medicine and Health, University College Cork (UCC), they used the FoLA tool to plan a simulation-based training for high-risk clinical situations using highly informative feedback. Data from these trainings will be collected and analyzed to determine how effective this training is in improving the performance of the attendees. The study is being planned to take place with around 100 doctors in training at two simulation training centers: at ASSERT Centre UCC and at…
Read More
New Pub: Feedback sources in essay writing: peer-generated or AI-generated feedback?

New Pub: Feedback sources in essay writing: peer-generated or AI-generated feedback?

Artificial Intelligence, Empirical Study, Feedback, Further Education, Journal, Publication
A newly published article discusses the use of peer feedback as a learning strategy, particularly in large classes where teachers face heavy workloads. For complex tasks like writing argumentative essays, peers may struggle to provide high-quality feedback due to the cognitive demands involved. The emergence of Artificial Intelligence (AI) tools, like ChatGPT, raises the question of whether AI can serve as a new feedback source for such tasks. To investigate this, a study compared ChatGPT-generated feedback with peer feedback on argumentative essays written by 74 graduate students from a Dutch university. The study collected essay data, peer feedback and ChatGPT-generated feedback, and then analyzed them using coding schemes. Results showed significant differences between ChatGPT and peer feedback, with ChatGPT offering more descriptive feedback while peers focused on identifying essay problems.…
Read More