Artificial Intelligence Archives - Page 2 of 8

Jul182024 by Heather WehnerNo Comments

New Pub: Revolutionizing Essay Scoring with Hierarchical Rater Models

Artificial Intelligence, Assessment, Higher Education, Journal, New Pub

For a special issue on Natural Language Processing in Psychology we proposed a hierarchical rater model-based approach to address the challenges in automatic essay scoring. Essay writing tests are an integral part of educational systems, essential for assessing students' critical thinking, articulation and understanding. Since the manual scoring process requires significant resources and time, teachers are beginning to use Automated Essay Scoring (AES), which is potentially capable of alleviating the manual effort involved. #AutomatedEssayScoring #NaturalLanguageProcessing #FormativeAssessment #EducationalTechnology #MachineLearning #AIinEducation #HierarchicalRaterModel #EdTech #ScoringAutomation #AI #AssessmentTools #MeasurementInvariance #TransformerModels #EducationResearch #UniversityTesting #AIModels #TechInEducation There are an abundance of available models and each one has its own unique features and scoring methods. Thus, selecting the optimal model is complex and challenging, especially when different aspects of content have to be assessed over a number…

Jul122024 by Prof. Dr. Hendrik DrachslerNo Comments

Advancing Automated Analysis of Concept Maps at AIED24

Artificial Intelligence, Feedback, Higher Education, Learning Analytics, Publication, School, Workshop, Workshop

The 25th International Conference on Artificial Intelligence in Education (AIED 2024), held from July 8-12 in Recife, Brazil, was a significant event for the Highly Informative Learning Analytics Research Programme. This year marked the first Brazilian-German cooperation in this field, supported by the Alexander Humboldt Foundation, the DIPF in Frankfurt and IPN in Kiel under the ALICE project. Two workshop papers presented at the conference showcased innovative approaches to automatically analyze concept maps, promising to automate the way educators assess and understand the student-created context. #AIED24 #LearningAnalytics #ConceptMaps #AIinEducation #EducationalTechnology #MachineLearning #CulturalDiversity #RealTimeFeedback #EdTech #AI #Education #CrossCulturalCollaboration Paper 1: The Influence of Diverse Educational Contexts on Concept Map Structures Authors: Laís P. Van Vossen, Isabela Gasparini, Elaine H. T. Oliveira, Berrit Czinczel, Ute Harms, Lukas Menzel, Sebastian Gombert, Knut Neumann,…

Jul22024 by Heather WehnerNo Comments

New pub: Potentials and Challenges of Generative AI in Instruction and Research on Instruction

Artificial Intelligence, Feedback, General education, Journal, New Pub, School

Artificial Intelligence (AI) is becoming such a part of our daily lives that soon it will be almost impossible to imagine life without it. Especially since the emergence of ChatGPT and other Large Language Models, endless new possibilities have arisen for the usage of AI in many areas, especially in educational settings. Currently, the effective use of AI in education, both in teaching and learning, remains largely undefined, as do its limitations. We are also missing clarity regarding the potential benefits of AI for instructional research and the ethical boundaries of its use in this field. The opportunities and challenges associated with integrating AI into educational practices and research are explored in a newly published article from Hendrik Drachsler, Knut Neumann and Jochen Kuhn. In their paper they identify specific…

Jul12024 by Sebastian GombertNo Comments

New pub: Predicting Item Difficulty and Item Response Time with Scalar-mixed Transformer Encoder Models and Rational Network Regression Heads

Artificial Intelligence, Assessment, Computational Psychometrics, Conference, Higher Education, Publication, Workshop

In a contribution to the BEA 2024 Shared Task, we addressed the challenge of predicting the difficulty and response time of multiple-choice questions from the United States Medical Licensing Examination® (USMLE®). This exam is an important assessment for medical professionals. To predict these variables, we evaluated various BERT-like pre-trained transformer models. We combined these models with Scalar Mixing and two custom 2-layer classification heads, using learnable Rational Activations as the activation function. This multi-task setup allowed us to predict both item difficulty and response time. The results were noteworthy. Our models placed first out of 43 participants in predicting item difficulty and fifth out of 34 participants in predicting item response time. This demonstrates the potential of advanced AI techniques in improving the evaluation processes of critical exams like the…

May132024 by Sebastian WollnyNo Comments

Dr. Diana Gayol Visits the EduTec Team

Artificial Intelligence, Higher Education, Transfer Activity

Last week we had the pleasure of welcoming Dr. Diana Gayol, Director of Diploma in Didactics and Pedagogy in Health Areas at the Faculty of Medicine of the Fundación Barceló in Buenos Aires (Argentina), to DIPF. Dr. Gayol's research focuses on psychological studies of Argentinean students and shows parallels with various activities of the TBA Center. On her research trip, she was able to make a stop at Campus Westend, where she was particularly interested in an exchange about future AI applications in argentinian education with Sebastian Wollny and Sebastian Gombert. Collaborative Discussions During her visit, Dr. Gayol engaged in dynamic discussions with our researchers. We explored topics ranging from personalized learning through Intelligent Tutoring Systems (ITS) to Chatbots and AI-driven analytics. Dr. Gayol emphasized the importance of bridging the…

May102024 by Heather WehnerNo Comments

Recap of the MODUS conference in Karlsruhe

Artificial Intelligence, Conference, Higher Education

As the echoes of insightful discussions and the energy of networking gradually settle, it's time to revisit the highlights of the German Rectors’ MODUS Conference which took place an April 10th and 11th 2024 in Karlsruhe. The conference titled “Recognition Culture in Higher Education. International Perspectives on Lifelong Learning and Student Mobility” brought together around 200 experts and interested parties from universities and research institutions, including Hendrik Drachsler and other representatives from the Goethe University. The conference produced a wealth of insights into the integration of artificial intelligence (AI) at universities. Discussions highlighted both opportunities and challenges, especially in the context of the digitalization of administration and teaching organizations. Instruments for various areas of application were presented, including information and communication tools such as chatbots and recommendation systems, as well…

Apr162024 by Heather WehnerNo Comments

New Pub: Feedback sources in essay writing: peer-generated or AI-generated feedback?

Artificial Intelligence, Empirical Study, Feedback, Further Education, Journal, Publication

A newly published article discusses the use of peer feedback as a learning strategy, particularly in large classes where teachers face heavy workloads. For complex tasks like writing argumentative essays, peers may struggle to provide high-quality feedback due to the cognitive demands involved. The emergence of Artificial Intelligence (AI) tools, like ChatGPT, raises the question of whether AI can serve as a new feedback source for such tasks. To investigate this, a study compared ChatGPT-generated feedback with peer feedback on argumentative essays written by 74 graduate students from a Dutch university. The study collected essay data, peer feedback and ChatGPT-generated feedback, and then analyzed them using coding schemes. Results showed significant differences between ChatGPT and peer feedback, with ChatGPT offering more descriptive feedback while peers focused on identifying essay problems.…

Apr112024 by Sebastian GombertNo Comments

Team led by Sebastian Gombert wins one of two tracks at BEA 2024 shared task on predicting Item Difficulty and Item Response Time

Artificial Intelligence, Assessment, Award, Computational Psychometrics, Conference, Higher Education, New Pub, Workshop

For standardized exams to be fair and reliable, they must include a diverse range of question difficulties to accurately assess test taker abilities. Additionally, it's crucial to balance the time allotted per question to avoid making the test unnecessarily rushed or sluggish. The goal of this year's BEA shared task (competition) was to build systems which could predict Item Difficulty and Item Response Time for items taken from the United States Medical Licensing Examination (USMLE). EduTec member Sebastian Gombert designed systems which are able to predict both variables simultaneously. These placed first out of 43 for predicting Item Difficulty and fitfth out of 34 for predicting Item Response Time. They use modified versions of established transformer language models in a multitask setup. A corresponding system description paper titled Predicting Item…

Mar202024 by Heather WehnerNo Comments

Didacta Presentation in Cologne: Key Questions to Find Fitting AI Solutions For Student Feedback

Artificial Intelligence, Feedback, General education, Invited talk, School

What are the goals of AI in education for student feedback? How can teachers make sure that their AI-assisted feedback goes beyond simple right/wrong statements and instead provides not only correct solutions, but also possibilities for improvement, hints on competence development and effective learning strategies? To find a fitting AI solution, there are key questions one should know to ask in advance. These questions were outlined by Hendrik Drachsler in his presentation at the didacta 2024 in Cologne on 20.02.2024 titled “Ihr KI-Anbieter-Test - 3 Schlüsselfragen die Sie kennen sollten.” The key questions: Question 1: What indicators does your AI product use to analyze learning outcomes? --> Look for AI products that provide relevant indicators for measuring learning progress and skills acquisition. These indicators are important to accurately assess learning…

Mar192024 by Heather WehnerNo Comments

Podcast “Sitzenbleiben” About AI in Education

Artificial Intelligence, General education, School

In a special edition of the DIPF podcast "Sitzenbleiben", Kai Maaz (Executive Director of DIPF) and Hendrik Drachsler discuss the potentials and hurdles of integrating artificial intelligence (AI) into education. The conversation surrounding AI's capabilities and constraints has been rapidly gaining traction. Especially the emergence of large language models like ChatGPT has revolutionized the text creation process, which showcase the vast opportunities that AI technologies can bring to the education sector. Questions abound regarding AI's impact on education: How can AI impact tasks such as homework or exams? How can AI enrich lessons? Which data protection issues need to be considered? How can students and educators receive adequate support in navigating AI's integration into learning environments? These questions serve as focal points which are examined in this newly available podcast…