Recovery of Multidimensional Item Response Theory Data Structures Using Multivariate Analyses

by Nichol, Penny Elisha, Ph.D., UNIVERSITY OF MINNESOTA, 2011, 630 pages; 3457111

Abstract:

The primary goal of this study was to investigate whether the structure of data generated by the most commonly used multidimensional item response theory (MIRT) models could be identified by frequently used multivariate methods. In item response theory (IRT) applications, a multivariate analysis procedure typically is recommended prior to estimating a given IRT model to ensure that the proper type of model (unidimensional vs. multidimensional) is used. Therefore, if IRT models are to be applied in testing practice, it is important to demonstrate that these dimensionality identifying procedures succeed.

This study employed a 2 (models for the multidimensional cases) × 3 (number of dimensions) × 4 (situations where the average discrimination parameters varied) × 2 (test lengths) model with 34 total cells. Seventy-five data sets were generated within each cell. Data sets were analyzed with four different methods—exploratory iterated principal factor analysis (IPFA), exploratory nonlinear factor analysis (NLFA), exploratory full-information factor analysis (FIFA), and nonmetric multidimensional scaling (MDS). Recovery of structure was determined using two sets of criteria: (1) “fit” statistics commonly used for each particular method and a statistic that was computed across methods (root mean square residual; RMSR) and (2) a comparison of relative magnitude of estimated and true item parameters using Spearman rank-order correlations.

Overall, the data generation model, true dimensionality, and the method of analysis were the most important factors for determining recovery. None of the methods recovered dimensionality well for all circumstances. Based on dimensionality recovery, NLFA best recovered unidimensional data, IPFA best recovered two-dimensional data, and MDS using the RMSR statistic best recovered three-dimensional data. With regard to structure, the NLFA and FIFA estimated values recovered the true parameters best.

AdviserDavid J. Weiss
SchoolUNIVERSITY OF MINNESOTA
Source TypeDissertation
SubjectsQuantitative psychology and psychometrics
Publication Number3457111

About ProQuest Dissertations & Theses
With nearly 4 million records, the ProQuest Dissertations & Theses (PQDT) Global database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

PQDT Global combines content from a range of the world's premier universities - from the Ivy League to the Russell Group. Of the nearly 4 million graduate works included in the database, ProQuest offers more than 2.5 million in full text formats. Of those, over 1.7 million are available in PDF format. More than 90,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.