Recovery of Multidimensional Item Response Theory Data Structures Using Multivariate Analyses
by Nichol, Penny Elisha, Ph.D., UNIVERSITY OF MINNESOTA, 2011, 630 pages; 3457111

Abstract:

The primary goal of this study was to investigate whether the structure of data generated by the most commonly used multidimensional item response theory (MIRT) models could be identified by frequently used multivariate methods. In item response theory (IRT) applications, a multivariate analysis procedure typically is recommended prior to estimating a given IRT model to ensure that the proper type of model (unidimensional vs. multidimensional) is used. Therefore, if IRT models are to be applied in testing practice, it is important to demonstrate that these dimensionality identifying procedures succeed.

This study employed a 2 (models for the multidimensional cases) × 3 (number of dimensions) × 4 (situations where the average discrimination parameters varied) × 2 (test lengths) model with 34 total cells. Seventy-five data sets were generated within each cell. Data sets were analyzed with four different methods—exploratory iterated principal factor analysis (IPFA), exploratory nonlinear factor analysis (NLFA), exploratory full-information factor analysis (FIFA), and nonmetric multidimensional scaling (MDS). Recovery of structure was determined using two sets of criteria: (1) “fit” statistics commonly used for each particular method and a statistic that was computed across methods (root mean square residual; RMSR) and (2) a comparison of relative magnitude of estimated and true item parameters using Spearman rank-order correlations.

Overall, the data generation model, true dimensionality, and the method of analysis were the most important factors for determining recovery. None of the methods recovered dimensionality well for all circumstances. Based on dimensionality recovery, NLFA best recovered unidimensional data, IPFA best recovered two-dimensional data, and MDS using the RMSR statistic best recovered three-dimensional data. With regard to structure, the NLFA and FIFA estimated values recovered the true parameters best.

 
AdviserDavid J. Weiss
SchoolUNIVERSITY OF MINNESOTA
SourceDAI/B 72-08, Jul 2011
Source TypeDissertation
SubjectsQuantitative psychology and psychometrics
Publication Number3457111
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3457111
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.