Training and Professional Development Committee Update (December 2019): 2020 Annual Meeting Pre-Conference Training Sessions

By Megan Welsh posted 12-20-2019 10:52



Co-Chairs: Kim Colvin & Anita Rawls


At NCME 2020, there will be over 30 pre-conference training sessions to choose from, covering a wide range of topics, including: classroom assessment, CAT, standard setting, big data, video games, using / programming in R and Python, score reports, test design, cognitive labs, and much more!

We are excited about two changes this year: (1) reduced prices for graduate students, and (2) the introduction of two-hour sessions.

Registration is already open for these sessions, so please take a look at the variety of offerings and decide if you want to take a deep dive into a topic for 8 hours or try something new in the 2- and 4-hour sessions.

Last year several sessions sold out weeks before the conference, so register right away!


NCME Pre-Conference Training Sessions

 Note: When registering for the AERA/NCME annual meetings, click on the NCME tab to find complete descriptions of all the trainings.


Thursday, April 16, 2020

8-Hour Sessions (8:00 AM to 5:00 PM)

NCME03         Assessment of Intrapersonal/Interpersonal Skills for K-12, Higher Education, and the Workplace

Presenters: Patrick Kyllonen, ETS; Jiyun Zu, ETS; Jiangang Hao, ETS

NCME04         Exploring, Visualizing, and Modeling Big Data with R

Presenters: Okan Bulut, University of Alberta; Christopher D. Desjardins, St. Michael's College

NCME08         Techniques and Software for Q-Matrix Estimation and Modeling Learning in Cognitive Diagnosis

Presenters: Steven Culpepper, University of Illinois at Urbana-Champaign; Jeffrey Douglas, University of Illinois at Urbana-Champaign; Shiyu Wang, University of Georgia; Yinghan Chen, University of Nevada Reno; James Balamuta, University of Illinois at Urbana-Champaign; Susu Zhang, Columbia University; Yawei Shen, The University of Georgia; Hulya Yigit, University of Illinois at Urbana-Champaign; Auburn Jimenez, University of Illinois at Urbana-Champaign


4-Hour Sessions (8:00 AM to 12 Noon)

NCME01         An Introduction to the Use of Telemetry Data in Video Game Analyses

                        Presenters: Gregory K. W. K. Chung, UCLA/CRESST; Elizabeth J. K. H. Redman, UCLA CRESST; Tianying Feng,                   
                        UCLA/CRESST; Jeremy D Roberts, PBS KIDS Digital

NCME02         An Intuitive Introduction to Maximum Likelihood and Bayesian Estimation for Applied Researchers

                        Presenter: Brian Habing, University of South Carolina

NCME05         Modeling Writing Process Using Keystroke Logs

                        Presenters: Mo Zhang, ETS; Hongwen Guo, ETS; Xiang Liu, ETS

NCME06         Optimal Test Design Approach to Fixed and Adaptive Test Construction using R

                        Presenter: Seung Choi, The University of Texas at Austin

NCME07         Python, Machine Learning, and Applications - A Gentle Introduction

                        Presenter: Zhongmin Cui, ACT, Inc.

NCME09         Using the R package PLmixed to Estimate Complex Measurement and Growth Models

                        Presenters: Nicholas Rockwood, Loma Linda University; Minjeong Jeon, UCLA


4-Hour Sessions (1:00 PM to 5:00 PM)

NCME10         Automated Report Generation: SAS and R Officer

                        Presenters: Elizabeth Patton, Curriculum Associates; Lucinda Simmons, Curriculum Associates

NCME12         Computerized Multistage Adaptive Testing: Theory and Applications

                        Presenters: Duanli Yan, ETS; Alina von Davier, ACTNext; Kyung Han, GMAC

NCME13         Item Response Theory and Scale Linking with jMetrik 5.0

                        Presenter: Patrick Meyer, NWEA

NCME14         LNIRT: joint modeling of responses (accuracy) and response times (speed)

                        Presenter: Jean-Paul Fox, University of Twente

NCME15         Response Similarity Analysis Using R

                        Presenter: Cengiz Zopluoglu, University of Miami


2-Hour Session (1:00 PM to 3:00 PM)

NCME11         Automated Test Assembly: Optimization and Heuristic Approaches

                        Presenters: Xiao Luo, Measured Progress; Kirk Alan Becker, Pearson


2-Hour Session (3:30 PM to 5:30 PM)

NCME16         Automated Test Assembly and More Fun with Optimization Algorithms in R

                        Presenters: Jason P Kopp, American Board of Surgery; Derek Sauder, James Madison University; Paulius Satkus, James Madison   


Friday, April 17, 2020

8-Hour Sessions (8:00 AM to 5:00 PM)

NCME17         Cognitive Diagnosis Modeling: A General Framework Approach and Its Implementation in R

                        Presenters: Jimmy de la Torre, Hong Kong University; Wenchao Ma, The University of Alabama

NCME18         Creating Interactive Applications with R Shiny

                        Presenters: Joshua Goodman, NCCPA; John Willse, UNCG; Christopher Runyon, NBME

NCME22         Test Equating: Methods and Practices - NCME Training Session

                        Presenter: Michael Kolen, University of Iowa

NCME24         Uni/multi-dimensional Computerized Adaptive Testing (CAT): Installation to Administration

                        Presenter: Murat Doğan Şahin, Eren Can Aybek,


4-Hour Sessions (8:00 AM to 12 Noon)

NCME19         Planning and Conducting Standard Setting

                        Presenter: Michael Bunch, Measurement Incorporated

NCME20         Qualitative Coding of Assessment Attributes: An Introduction to Feature Analysis

                        Presenters: Jenny C. Kao, UCLA CRESST; Elizabeth J. K. H. Redman, UCLA CRESST; Gregory K. W. K. Chung, UCLA/CRESST

NCME23         Tools and Strategies for the Design and Evaluation of Score Reports

                        Presenters: Priya Kannan, ETS; Diego Zapata, ETS; Priya Kannan, ETS; April Zenisky, University of Massachusetts Amherst;         
                        Sharon C Slater, ETS; Gavin Thomas Lumsden Brown, The University of Auckland


2-Hour Sessions (8:00 AM to 10:00 AM)

NCME21         Test Accessibility: What Psychometricians and Test Developers Need to Know

                        Presenters: Anne H. Davidson, EdMetric LLC; Stephanie W Cawthon, University of Texas - Austin; Vitaliy Shyyan, Smarter 
                        alanced Assessment Consortium

NCME25         Using School-Level Data from the Stanford Education Data Archive

                        Presenters: Sean F. Reardon, Stanford University; Andrew Ho, Harvard Graduate School of Education; Benjamin R Shear, University 
                        of Colorado Boulder; Erin M. Fahle, St. John's University


2-Hour Sessions (10:30 AM to 12:30 PM)

NCME26         Examining the Consequences of Assessment Design and Use Because Assessment Matters

                        Presenter: David H Slomp, University of Lethbridge; Maria Elena Oliveri, ETS

NCME27         Methodologies and Tools for Think Alouds and Cognitive Laboratories

                        Presenters: Blair Lehman, ETS; Andre Alexander Rupp, ETS (ETS); Jacqueline P. Leighton, University of Alberta


4-Hour Sessions (1:00 PM to 5:00 PM)

NCME29         An Overview of Psychometric Work at Various Testing Organizations

                        Presenters: JongPil Kim, Houghton Mifflin Harcourt Assessment; Jinghua Liu, The Enrollment Management Association; Hyeon-Joo 
                       Oh, ETS; Ye N/A Tong, Pearson; Hanwook (Henry) Yoo, ETS

NCME31         Experiencing a New Approach to Reliability for Classroom Assessment

                        Presenters: Paul Zachos, ACASE; Monica De Tuya, ACASE; Jason Brechko, Glens Falls Central School District/ACASE; Panpan
                       Yang, University at Albany

NCME32         Making Measurement Matter: A Practical Guide for Assessment Directors and Test Users

                        Presenters: Stephen Sireci, University of Massachusetts Amherst; Vince Verges, Florida Department of Education; Arthur Thacker,


NCME33         Using Stan for Bayesian Psychometric Modeling

                        Presenters: Yong Luo, ETS; Manqian Liao, University of Maryland, College Park


2-Hour Sessions (1:00 PM to 3:00 PM)

NCME28         A Visual Introduction to Computerized Adaptive Testing

                        Presenters: Yuehmei Chien, NWEA; David Shin, Pearson

NCME30         Cognitive Principles for Assessment Research and Test Development

                        Presenters: Marlit Annalena Lindner, IPN - Leibniz Institute for Science and Mathematics Education; Madeleine Keehner, ETS


2-Hour Session (3:30 PM to 5:30 PM)

NCME34         MIRT Graphics using RShiny

                        Presenters: Terry Ackerman, University of Iowa; Qing Xie, ETS

NCME35         Using SAS for Monte Carlo Simulation Studies in Item Response Theory

                        Presenters: Brian Leventhal, James Madison University; Allison Ames, University of Arkansas