Advancing Natural Language Processing in Educational Assessment

Advancing Natural Language Processing in Educational Assessment
Author: Victoria Yaneva
Publisher: Taylor & Francis
Total Pages: 339
Release: 2023-06-05
Genre: Education
ISBN: 1000904199

Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers. The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.


Advancing Natural Language Processing in Educational Assessment

Advancing Natural Language Processing in Educational Assessment
Author: Victoria Yaneva
Publisher:
Total Pages: 0
Release: 2023
Genre: Educational tests and measurements
ISBN: 9781000904161

"Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers"--


The Routledge International Handbook of Automated Essay Evaluation

The Routledge International Handbook of Automated Essay Evaluation
Author: Mark D. Shermis
Publisher: Taylor & Francis
Total Pages: 647
Release: 2024-06-27
Genre: Psychology
ISBN: 1040033245

The Routledge International Handbook of Automated Essay Evaluation (AEE) is a definitive guide at the intersection of automation, artificial intelligence, and education. This volume encapsulates the ongoing advancement of AEE, reflecting its application in both large-scale and classroom-based assessments to support teaching and learning endeavors. It presents a comprehensive overview of AEE's current applications, including its extension into reading, speech, mathematics, and writing research; modern automated feedback systems; critical issues in automated evaluation such as psychometrics, fairness, bias, transparency, and validity; and the technological innovations that fuel current and future developments in this field. As AEE approaches a tipping point of global implementation, this Handbook stands as an essential resource, advocating for the conscientious adoption of AEE tools to enhance educational practices ethically. The Handbook will benefit readers by equipping them with the knowledge to thoughtfully integrate AEE, thereby enriching educational assessment, teaching, and learning worldwide. Aimed at researchers, educators, AEE developers, and policymakers, the Handbook is poised not only to chart the current landscape but also to stimulate scholarly discourse, define and inform best practices, and propel and guide future innovations.


The Oxford Handbook of Computational Linguistics

The Oxford Handbook of Computational Linguistics
Author: Ruslan Mitkov
Publisher: Oxford University Press
Total Pages: 1377
Release: 2022-06-02
Genre: Language Arts & Disciplines
ISBN: 019162554X

Ruslan Mitkov's highly successful Oxford Handbook of Computational Linguistics has been substantially revised and expanded in this second edition. Alongside updated accounts of the topics covered in the first edition, it includes 17 new chapters on subjects such as semantic role-labelling, text-to-speech synthesis, translation technology, opinion mining and sentiment analysis, and the application of Natural Language Processing in educational and biomedical contexts, among many others. The volume is divided into four parts that examine, respectively: the linguistic fundamentals of computational linguistics; the methods and resources used, such as statistical modelling, machine learning, and corpus annotation; key language processing tasks including text segmentation, anaphora resolution, and speech recognition; and the major applications of Natural Language Processing, from machine translation to author profiling. The book will be an essential reference for researchers and students in computational linguistics and Natural Language Processing, as well as those working in related industries.


Uses of Artificial Intelligence in STEM Education

Uses of Artificial Intelligence in STEM Education
Author: Xiaoming Zhai
Publisher: Oxford University Press
Total Pages: 625
Release: 2024-10-24
Genre: Computers
ISBN: 0198882084

In the age of rapid technological advancements, the integration of Artificial Intelligence (AI), machine learning (ML), and large language models (LLMs) in Science, Technology, Engineering, and Mathematics (STEM) education has emerged as a transformative force, reshaping pedagogical approaches and assessment methodologies. Uses of AI in STEM Education, comprising 25 chapters, delves deep into the multifaceted realm of AI-driven STEM education. It begins by exploring the challenges and opportunities of AI-based STEM education, emphasizing the intricate balance between human tasks and technological tools. As the chapters unfold, readers learn about innovative AI applications, from automated scoring systems in biology, chemistry, physics, mathematics, and engineering to intelligent tutors and adaptive learning. The book also touches upon the nuances of AI in supporting diverse learners, including students with learning disabilities, and the ethical considerations surrounding AI's growing influence in educational settings. It showcases the transformative potential of AI in reshaping STEM education, emphasizing the need for adaptive pedagogical strategies that cater to diverse learning needs in an AI-centric world. The chapters further delve into the practical applications of AI, from scoring teacher observations and analyzing classroom videos using neural networks to the broader implications of AI for STEM assessment practices. Concluding with reflections on the new paradigm of AI-based STEM education, this book serves as a comprehensive guide for educators, researchers, and policymakers, offering insights into the future of STEM education in an AI-driven world.


Challenges and Innovations in Speaking Assessment

Challenges and Innovations in Speaking Assessment
Author: Larry Davis
Publisher: Taylor & Francis
Total Pages: 202
Release: 2024-09-19
Genre: Language Arts & Disciplines
ISBN: 1351782193

The assessment of second language speaking ability has played a central role in the evolution of language testing theory and practice. Educational Testing Service (ETS) has been a primary innovator in all dimensions of speaking assessment since the 1970s, addressing critical challenges through the advent of new test designs, scoring practices, and measurement technologies to make especially large-scale, standardized testing of speaking ability a reality. This volume presents a sample of key ETS research and development efforts related to speaking assessment over the years. The contributors highlight diverse contributions to conceptualizing the speaking construct, designing speaking test tasks, scoring speech samples, marshalling technologies for test delivery and automated scoring, and developing end-to-end speaking assessment procedures. The first part emphasizes how some of the earliest large-scale speaking assessments were designed and put into practice. The second part features research and development related to speaking assessments in the TOEIC and TOEFL testing suites, emphasizing their validity and scoring. The third part introduces research-based innovations in testing new and more nuanced speaking constructs, and in using automated scoring of speech to address diverse assessment needs. The volume will appeal to language testing professionals and test score users in illuminating how ETS has influenced the development of speaking assessment as well as pointing to multiple directions for future research and practice.


Principles and Applications of Adaptive Artificial Intelligence

Principles and Applications of Adaptive Artificial Intelligence
Author: Lv, Zhihan
Publisher: IGI Global
Total Pages: 332
Release: 2024-01-24
Genre: Computers
ISBN:

The rapid adoption of deep learning models has resulted in many business services becoming model services, yet most AI systems lack the necessary automation and industrialization capabilities. This leads to heavy reliance on manual operation and maintenance, which not only consumes power but also causes resource wastage and stability issues during system mutations. The inadequate self-adaptation of AI systems poses significant challenges in terms of cost-effectiveness and operational stability. Principles and Applications of Adaptive Artificial Intelligence, edited by Zhihan Lv from Uppsala University, Sweden, offers a comprehensive solution to the self-adaptation problem in AI systems. It explores the latest concepts, technologies, and applications of Adaptive AI, equipping academic scholars and professionals with the necessary knowledge to overcome the challenges faced by traditional business logic transformed into model services. With its problem-solving approach, real-world case studies, and thorough analysis, the Handbook provides practitioners with practical ideas and solutions, while also serving as a valuable teaching material and reference guide for students and educators in AI-related disciplines. By emphasizing self-adaptation, continuous model iteration, and dynamic learning based on real-time feedback, the book empowers readers to significantly enhance the cost-effectiveness and operational stability of AI systems, making it an indispensable resource for researchers, professionals, and students seeking to revolutionize their research and applications in the field of Adaptive AI.


Entrustable Professional Activities and Entrustment Decision-Making in Health Professions Education

Entrustable Professional Activities and Entrustment Decision-Making in Health Professions Education
Author: Olle ten Cate
Publisher: Ubiquity Press
Total Pages: 340
Release: 2024-10-29
Genre: Medical
ISBN: 1914481615

This book discusses the ins and outs of a new approach to competency-based education in the education and training of health professionals, including doctors and medical specialists, but also nurses, dentists, pharmacists, veterinarians, physiotherapists and others. Embedded in a conceptual discussion of what competence in health professionals means, the book discusses theoretical foundations of trust and entrustment of trainees with the practice of patient care tasks. It elaborates the implications for identifying the objectives of training, formulated as entrustable professional activities (EPAs), for the associated curriculum development, for assessment of trainees in the clinical workplace, for faculty development and for the management of large scale change in health professions education. In the past decade, EPAs have been proposed, piloted or implemented in all sectors of health professions education and in countries across all continents. Yet, there is a widely felt desire for a better understanding of all related concepts. This text was written with teachers, educational managers, educational scholars, and health profession trainees in mind. The book is the result of a collaboration of fifty highly engaged authors, all actively involved in their own projects and studies around EPAs and workplace-based assessment, as teachers, developers and managers. All chapters have been critically read and commented on by internal and external reviewers, making this work a state of the art document about the topic.


The Concise Companion to Language Assessment

The Concise Companion to Language Assessment
Author: Antony John Kunnan
Publisher: John Wiley & Sons
Total Pages: 725
Release: 2024-10-01
Genre: Education
ISBN: 1394179596

The Concise Companion to Language Assessment provides a state-of-the-art overview of the crucial areas of language assessment, teaching, and learning. Edited by one of the foremost scholars in the field, The Concise Companion combines newly commissioned articles on innovations in assessment with a selection of chapters from The Companion to Language Assessment, the landmark four-volume reference work first published in 2013. Presented in eight themes, The Concise Companion addresses a broad range of language assessment methods, issues, and contexts. Forty-five chapters cover assessment conceptualization, development, research, and policy, as well as recent changes in language assessment technology, learning-oriented assessment, teacher-based assessment, teacher assessment literacy, plurilingual assessment, assessment for immigration, and more. Exploring the past, present, and future possibilities of the dynamic field, The Concise Companion to Language Assessment: Contains dedicated chapters on listening, speaking, reading writing, vocabulary, pronunciation, intercultural competence, and other language skills Describes fundamental assessment design and scoring guidelines, as well as advanced concepts in scenario-based assessment and automated performance scoring Provides insights on different assessment environments, such as classrooms, universities, employment, immigration, and healthcare Covers various qualitative and quantitative research methods, including introspective methods, classical reliability, and structural equation modeling Discusses the impacts of colonialism and discrimination on the history of language assessment Explores the use of AI in writing evaluation, plagiarism and cheating detection, and other assessment contexts Sure to become a standard text for the next generation of applied linguistics students, The Concise Companion to Language Assessment is an invaluable textbook for undergraduate and graduate courses in applied linguistics, language assessment, TESOL, second language acquisition, and language policy.