An alternative examinee-centered standard setting strategy
by Irwin, Patrick M., Ph.D., THE UNIVERSITY OF NEBRASKA - LINCOLN, 2007, 145 pages; 3245357

Abstract:

This study examined an alternative examinee-centered standard setting method that is a modification of the Contrasting Groups method called the Modified Contrasting Groups method (MCGM). The alternative method was designed to be affordable, not too complex computationally, and done in a reasonable amount of time. The study investigated how well the alternative method produced results that are approximately equivalent to other standard setting methods. The results generated by the MCGM were compared to the results produced by the Angoff method, Contrasting Groups method, and the Borderline Group method.

Two variations of the alternative method (MCGM 1 and MCGM 2) were explored in the study. MCGM 1 and MCGM 2 are based on having teacher predictions of student performance and the students' actual performance or scores on an assessment. The MCGM 1 and MCGM 2 follow different but standard mathematical procedures that are easy to follow. The calculation for the MCGM 1 requires finding the median score for each performance category, then calculating the average of the two adjacent performance categories. MCGM 2 is based on combining the adjacent performance categories and calculating a median value of the scores in the two adjacent categories.

This study found that MCGM 1 and MCGM 2 produced cut scores higher than the Angoff and Contrasting Groups method on average, but lower than the Borderline Group method. The study also found the MCGM 1 and MCGM 2 consistently produced different cut scores using the same data sets.

The MCGM 1 and MCGM 2 appear to be viable standard setting methods for many school districts in Nebraska to use to meet state and federal reporting requirements. For some districts, either or both of these variations could be added to what is currently in place to provide a range of plausible cut scores. For other districts, this method could be adopted as the sole cut score method.

 
AdviserJames C. Impara
SchoolTHE UNIVERSITY OF NEBRASKA - LINCOLN
SourceDAI/B 67-12, p. , Mar 2007
Source TypeDissertation
SubjectsEducational tests & measurements; Quantitative psychology and psychometrics
Publication Number3245357
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3245357
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.