Digital Module 29


ITEMS Portal Menu

Digital Modules     Home     Print Modules


2e8cabc8-b979-47c3-a86c-b187f0ce837e

Multidimensional Item Response Theory Equating


Module Overview

In this digital ITEMS module, Dr. Stella Kim provides an overview of multidimensional item response theory (MIRT) equating. Traditional unidimensional item response theory (IRT) equating methods impose the sometimes untenable restriction on data that only a single ability is assessed. In this module, Dr. Kim discusses potential sources of multidimensionality and presents the potential consequences of multidimensionality on equating. To remedy these effects, MIRT equating can be used as a viable alternative to traditional methods of IRT equating. In conducting MIRT equating, the choice of an appropriate MIRT model is necessary, and thus the module describes several existing MIRT models and illustrates each using hypothetical examples. After a brief description of MIRT models, an extensive review of the current literature is presented to identify gaps in the literature on MIRT equating. Then, the steps for conducting MIRT observed-score equating are described. Finally, the module discusses practical considerations in applying MIRT equating to testing practices and suggests potential areas of research for future studies.

Meet the Instructor

StellaKim.jpg

Stella Y. Kim, University of North Carolina at Charlotte

Assistant Professor


Dr. Stella Kim is an Assistant Professor of Educational Research, Measurement, and Evaluation at the University of North Carolina at Charlotte. Her research lies in educational measurement, with a specific focus on theoretical and methodological advancements in item response theory scaling, linking, and equating. Dr. Kim also conducts research on improving methodological approaches to computing the reliability of criterion-referenced tests (i.e., decision consistency and accuracy). Her research interests also include methodological advancement and application of generalizability theory. Before joining UNC Charlotte in 2018, Dr. Kim earned her Ph.D. in educational measurement from University of Iowa, and worked as a graduate research assistant in the Center for Advanced Studies in Measurement and Assessment (CASMA) at the University of Iowa.

Contact Stella Kim: stella-kim@uncc.edu 

Abstract

INTRODUCTION

Upon completion of this ITEMS module, learners should be able to:
  • Explain benefits of using multidimensional IRT equating
  • List multidimensional IRT models that have been applied to equating in the literature
  • Describe the current literature on multidimensional IRT equating
  • Conduct multidimensional IRT observed-score equating
  • Examine potential research topics in multidimensional IRT equating




Module Content

SECTION 1

Introduction to MIRT equating

Upon completion of this section, learners should be able to:
  • Describe the unidimensionality assumption required by IRT
  • List potential sources of multidimensionality of a test
  • Explain benefits of using multidimensional IRT in the context of equating
Video: 

Interactive Learning Check:
Learning Check - Section 1
Please right click on File. Then, click "Save Link As..." and open with PowerPoint on your PC.

SECTION 2

Multidimensional IRT Models

Upon completion of this section, learners should be able to:
  • List multidimensional IRT models that have appeared in the equating context
  • Describe characteristics of each MIRT model
  • Give examples in which each model is appropriate to be used
Video: 

Interactive Learning Check:
Learning Check - Section 2
Please right click on File. Then, click "Save Link As..." and open with PowerPoint on your PC.

SECTION 3

Literature on MIRT Equating

Upon completion of this section, learners should be able to:
  • Explain the history of MIRT equating research
  • Summarize the major findings on MIRT equating reported by previous studies
  • Articulate the gap in the MIRT equating literature
  • Explain challenges associated with MIRT true-score equating

Video: 

Interactive Learning Check:
Learning Check - Section 3
Please right click on File. Then, click "Save Link As..." and open with PowerPoint on your PC.

SECTION 4

MIRT Observed-Score Equating

Upon completion of this section, learners should be able to:
  • Describe how observed-score equating is performed with MIRT models
  • Identify differences between MIRT observed-score equating and UIRT observed-score equating
Video: 

Interactive Learning Check:
Learning Check - Section 4
Please right click on File. Then, click "Save Link As..." and open with PowerPoint on your PC.

SECTION 5

Future Research

Upon completion of this section, learners should be able to:
  • Recognize practical constraints or considerations in applying MIRT equating to practices
  • Describe how to evaluate usefulness and appropriateness of MIRT equating in operational settings
  • Examine potential research topics
Video: 

Interactive Learning Check:
Learning Check - Section 5
Please right click on File. Then, click "Save Link As..." and open with PowerPoint on your PC.

SECTION 6

Activity

Please download the zip file for the activity. 
  • Within the Zip file, you will find datasets, syntax files, and output necessary to complete the activity. 
  • Activity_Files.zip
    • Please right click on File. Then, click "Save Link As...". 
Video: 


Downloadable Content

Click to view or Right Click and "Save Link as..."
Slides: Slides.pdf