Cognitive skill diagnosis in the presence of differential strategy choice: A Bayesian approach
by Rho, Yun Jin, Ph.D., COLUMBIA UNIVERSITY, 2010, 132 pages; 3420712

Abstract:

Problem solvers who know several different solution methods or strategies for a problem may choose a strategy flexibly for each problem in order to lessen cognitive load or to maximize accuracy of performance under time pressure. This idea is explored, and consideration is given to how this issue of multiple-strategy use will affect cognitive skill diagnosis. The "adaptive strategy choice" hypothesis is proposed, which states that if test takers know more than one solution strategy, they will tend to choose the easiest effective strategy for a particular problem. This idea is applied to a well-known problem-solving domain — that of mixed-fraction subtraction. In this domain, adaptive strategy choice leads to a hybrid strategy ("Method C") in addition to the previously recognized Methods A (convert mixed numbers to improper fractions; Tatsuoka, 1990) and B (separate mixed numbers into integer and fraction). The idea of Method C is that people can select strategies on each item, using whichever strategy is easier between Method A and B. Previous research has concluded that Method B explains the data better. However, the present results from multiple regression and mixed effects logistic regression analyses show that Method C works better than Method A or B to predict the item difficulties.

The second goal of this research is to develop methods for cognitively diagnostic testing that work effectively in the presence of multiple strategy use. A new model, the "Mix-NIDA" model, is proposed that allows the solution strategy used by problem solvers to vary so that people can be classified into different strategy groups. Two versions of this Mix-NIDA model are defined, and a fitting method is developed using a Bayesian analysis framework. The proposed fitting method is validated via simulation studies. A number of models are then defined assuming different potential mixtures of the three strategies (Methods A, B, or C) using the Mix-NIDA framework, and the models are applied to the mixed fraction subtraction data The Mix-NIDA model assuming use of all three strategies fits the data best This Mix-NIDA model classifies about 50% of the participants as Method C users.

 
AdviserJames E. Corter
SchoolCOLUMBIA UNIVERSITY
SourceDAI/B 71-09, p. , Sep 2010
Source TypeDissertation
SubjectsEducational tests & measurements; Educational psychology; Quantitative psychology and psychometrics
Publication Number3420712
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3420712
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.