Journal – EduTec Science

May42023 by Ioana JivetNo Comments

New Pub: A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards

Journal, Learning Analytics, Publication

Higher education institutions are moving to design and implement teacher-facing learning analytics (LA) dashboards with the hope that instructors can extract deep insights about student learning and make informed decisions to improve their teaching. While much attention has been paid to developing teacher-facing dashboards, less is known about how they are designed, implemented and evaluated. This paper presents a systematic literature review of existing studies reporting on teacher-facing LA dashboards. Out of the 1968 articles retrieved from several databases, 50 articles were included in the final analysis. Guided by several frameworks, articles were coded based on the following dimensions: purpose, theoretical grounding, stakeholder involvement, ethics and privacy, design, implementation, and evaluation criteria. The findings show that most dashboards are designed to increase teachers’ awareness but with limited actionable insights to…

Mar82023 by Sebastian WollnyNo Comments

New Pub: Students’ expectations of Learning Analytics across Europe

Higher Education, Journal, Learning Analytics

What do European students expect from Learning Analytics? To help Higher Education Institutions (HEIs) develop and implement Learning Analytics systems that support students' learning, a new article of Sebastian Wollny et al. investigates in the Journal of Computer Assisted Learning the individual LA expectations of European higher education students. In this article a ‘Student Expectations of Learning Analytics Questionnaire’ (SELAQ) survey with 417 participating students was applied at the Goethe University Frankfurt (Germany) and compared with responses of students from Madrid (Spain), Edinburgh (United Kingdom) and the Netherlands. Results: The results show that students’ expectations at Goethe University Frankfurt itself are rather homogeneous regarding ‘LA Ethics and Privacy’ and ‘LA Service Features’. Furthermore, it reveals that European students generally show a consistent pattern of expectations of LA with a high…

Dec142022 by Joshua WeidlichNo Comments

New Pub: Causal Inference and Bias in Learning Analytics

Journal, Learning Analytics, Literature review, Open access, Publication, Research Methods

Learning Analytics is an applied field of research with the goal of producing actionable knowledge to improve student learning. This requires knowledge about cause-and-effect. However, randomized experiments, the usual vehicle for causality, are not always feasible nor desirable. Researchers are then left with observational data, from which they are, understandably, hesitant to draw causal inferences. Fortunately, there has been a lot of progress on the topic of causality in the last two decades. One prominent framework uses Directed Acyclic Graphs (DAGs) to graphically reason about cause-and-effect and/or bias. This primer, authored by Joshua Weidlich, Dragan Gasevic, and Hendrik Drachsler, published in the Journal of Learning Analytics, introduces DAGs to Learning Analytics. Using fictitious and published examples, we show how DAGs are a principled approach to a) improve causal inferences for…

Oct312022 by Prof. Dr. Hendrik DrachslerNo Comments

New Pub: Untangling connections between challenges in the adoption of learning analytics in higher education

Empirical Study, Higher Education, Journal, Learning Analytics, Publication

[caption id="attachment_4599" align="alignnone" width="967"] Associations of challenges and ethics: (a) none, (b) prep-partial, and (c) full adoption institutions[/caption] Potential benefits of learning analytics (LA) for improving students' performance, predicting students' success, and enhancing teaching and learning practice have increasingly been recognized in higher education. However, the adoption of LA in higher education institutions (HEIs) to date remains sporadic and predominantly small in scale due to several socio-technical challenges. To better understand why HEIs struggle to scale LA adoption, it is needed to untangle adoption challenges and their related factors. This paper presents the findings of a study that sought to investigate the associations of adoption factors with challenges HEIs face in the adoption of LA and how these associations are compared among HEIs at different scopes of adoption. The study…

Sep62022 by Prof. Dr. Hendrik DrachslerNo Comments

New Pub: FoLA2 — A Method for Co-creating Learning Analytics–Supported Learning Design

Further Education, General education, Higher Education, Journal, Learning Analytics, Learning Design, Open access, Publication, School

Finally, we have published an article about the FOLA2 method that we have used for over two years frequently to design Learning Analytics supported Learning Designs with teachers of various backgrounds. Learning activities are at the core of every educational design effort. Designing learning activities is a process that benefits from reflecting on previous runs of those activities. One way to measure the behaviour and effects of design choices is to use learning analytics (LA). The challenge, however, lies in the unavailability of an easy-to-use, LA-supported learning design (LD) method. We established a method—the Fellowship of Learning Activities and Analytics (FoLA2)—reinforced by a gameboard and cards to provide structure and inspiration. The method enables several participants with different roles to interact with a set of card decks to create an…

Aug292022 by Ioana JivetNo Comments

New Pub: Tools Designed to Support Self-Regulated Learning in Online Learning Environments: A Systematic Review

Higher Education, Journal, Learning Analytics, Self-Regulation

Self-regulated learning (SRL) is a crucial higher-order skill required by learners of the 21st century, who will need to become lifelong learners to adapt to the continually changing environments. Literature provides examples of tools for scaffolding SRL in online environments. In this study, we provide the state-of-the-art concerning tools that support SRL in terms of theoretical models underpinning development, supported SRL processes, tool functionalities, used data and visualizations. We reviewed 42 articles published between 2008 and 2020, including information from 25 tools designed to support SRL. Our findings indicate that (1) many of the studies do not explicitly specify the SRL theoretical model used to guide the design process of the tool; (2) goal setting, monitoring, and self-evaluation are the most prevalent SRL processes supported through functionalities such as content…

Aug262022 by Prof. Dr. Hendrik DrachslerNo Comments

New Pub: Toward learning progression analytics — Developing learning environments for the automated analysis of learning using evidence-centred design

Computational Psychometrics, Journal, Learning Analytics, Learning Design, Open access, Project, Publication, School

[caption id="attachment_4319" align="alignright" width="450"] A procedure for developing digital learning environments that allow for the automated assessment of learning.[/caption] National educational standards stress the importance of science and mathematics learning for today’s students. However, across disciplines, students frequently struggle to meet learning goals about core concepts like energy. Digital learning environments enhanced with artificial intelligence hold the promise to address this issue by providing individualized instruction and support for students at scale. Scaffolding and feedback, for example, are both most effective when tailored to students’ needs. Providing individualized instruction requires continuous assessment of students’ individual knowledge, abilities, and skills in a way that is meaningful for providing tailored support and planning further instruction. While continuously assessing individual students’ science and mathematics learning is challenging, intelligent tutoring systems show that it…

Aug242022 by Dana KubeNo Comments

New Pub: Gendered differences versus doing gender: a systematic review on the role of gender in CSCL

Gender, Higher Education, Journal, Literature review, Meta-study, Open access, Publication, Special Issue, Team

How has CSCL research been treating the topic of Gender? Our systematic review on this topic is now published in Unterrichtswissenschaft and available online here. Gender equity in education is an essential UN sustainable development goal. However, it is unclear what aspects of gender are important to consider in regard to research outcomes as well as how findings can be interpreted in the context of gender stereotypes and bias. This lack of clarity is particularly salient in the STEM field. Computer-supported collaborative learning (CSCL) is a group learning method where learners work together on group tasks that aim at the sharing and co-construction of knowledge. Aside from the cognitive learning gains, the literature reports that CSCL can bring social and psychological benefits, such as fostering positive mutual relationships and increased understanding of equity and…

Jul272022 by Atezaz AhmadNo Comments

New Pub: Connecting the dots – A literature review on learning analytics indicators from a learning design perspective

Empirical Study, Higher Education, Journal, Learning Analytics, Learning Design, Lifelong Learning, Literature review, Open access, Publication, Self-Regulation, Special Issue, Target group

[caption id="attachment_4329" align="alignright" width="450"] Occurrences of the most commonly used learning analytic indicators over the past 10 years[/caption] Background: During the past decade, the increasingly heterogeneous field of learning analytics has been critiqued for an over-emphasis on data-driven approaches at the expense of paying attention to learning designs. Method and objective: In response to this critique, we investigated the role of learning design in learning analytics through a systematic literature review. 161 learning analytics (LA) articles were examined to identify indicators that were based on learning design events and their associated metrics. Through this research, we address two objectives. First, to achieve a better alignment between learning design and learning analytics by proposing a reference framework, where we present possible connections between learning analytics and learning design. Second, to present how…

Jul232022 by Dana KubeNo Comments

Gender & STEM Conference 2022 – EduTec Member Dana Kube presented her Ph.D. work

Assessment, Conference, Conference, Digitalisation, Event, Higher Education, Journal, Learning Design, Publication, Workshop

A few impressions: After a two-year break, scholars can finally meet again for a personal exchange at the "Gender & STEM Conference". I was able to meet so many exciting people and studies, and I think that we German universities have benefited especially from the intersectional and feminist perspectives from the USA, Canada and the Netherlands: How do transgender students experience support in Computer Science? What can universities do to keep students of colour and especially women* of colour longer in STEM programmes? Stop fixing Women* in STEM was the tenor, fix the System: I go back to Frankfurt with a lot of smart approaches on the institutional and pedagogical level and a lot of encouraging feedback on my PhD thesis on Gender in STEM/Technology. My personal highlight was meeting…