The reliability, convergence, and predictive validity of personality ratings: An other perspective
by Connelly, Brian Samuel, Ph.D., UNIVERSITY OF MINNESOTA, 2008, 374 pages; 3324415

Abstract:

Although personality psychology has largely been built on findings based on self-report measures, descriptions of a target individual's personality from an observer (other-ratings) have bolstered and extended major findings from personality research. The veracity of these other-ratings, however, has been a longstanding research question and point of contention. Although work using other-ratings has spanned across multiple research streams, key issues are (1) how accurate other-ratings are (as indexed by a particular criterion) and (2) the conditions under which other-ratings are more or less accurate (as a result, for example, of a particular trait being easier to rate or of having higher quality information about the target). Four meta-analyses were conducted to empirically examine hypotheses derived from Funder's (1995) Realistic Accuracy Model, with each meta-analyses examining a particular accuracy criterion. Specifically, these meta-analyses examined how the ease of rating particular traits within the five factor model moderates accuracy ("good traits"). In addition, these meta-analyses examine how the quality of information available to others moderates accuracy ("good information"), either through having a particular type of relationship with the target (being a family member, friend, cohabitator, work colleague, incidental acquaintance, or stranger) or through observing particular target-related stimuli (visual information only, audio information only, audio and visual, personal objects, or text/electronic communication).

Study 1 meta-analyzed internal consistency and test-retest reliability coefficients for other raters. Findings indicate that other-ratings are measured at least as reliably as self-ratings, regardless of the particular trait being measured or of the particular information source. Study 2 meta-analyzed the consistency between two different other-raters' descriptions of a common target (interrater reliability). Interrater reliability was higher when rating more visible traits like Extraversion and Conscientiousness but lower for less visible traits like Emotional Stability and Openness. Interrater reliabilities were also higher when either (a) ratings came from others well-acquainted with the target or (b) both other-raters viewed a limited but overlapping set of the target's behaviors. Study 3 meta-analyzed correlations of other-ratings with self-ratings. Self-other correlations were highest when (a) the trait was highly visible, (b) opportunity to observe the target was high and not limited to only observing thin slices of behavior, and (c) the rating came from an other who was particularly intimate with the target. Finally, Study 4 meta-analyzed validities of other-ratings for predicting behaviors and behavioral outcomes. When predicting how strangers will perceive the target, ratings from acquainted other-raters predicted similarly to self-ratings. When predicting academic and job performance, however, validities for other-ratings were markedly higher than general findings for self-ratings. This was especially true for ratings of Conscientiousness and Emotional Stability when predicting academic achievement and for ratings of Conscientiousness and Agreeableness when predicting job performance.

The pattern of findings described in Studies 1 through 4 points to several general conclusions. Self-ratings and other-ratings both measure a common construct of personality dispositions. For other-ratings to be accurate, however, other-raters must have adequate opportunity to observe the target. This accuracy is enhanced when other-raters have access to internal aspects of the target's personality (thoughts, emotions, values, etc.) as a result of interpersonal intimacy. To the extent that such opportunities are lacking to observe both external and internal aspects of the target, other-raters may use implicit personality theories to fill in gaps in observation. Finally, Study 4 is suggestive of a relative predictive advantage of other-ratings over self-ratings. Whether resulting from greater accuracy of other-ratings or having a context and scope more closely aligned with the behavioral criterion, these behavioral predictions offer promising new directions for studying personality and applying personality measures. Broadly, these findings suggest that other-ratings can serve not only as an accurate, alternative method for collecting personality ratings but also as a tool illuminating fundamental aspects of personality and personality measurement.

 
AdviserDeniz S. Ones
SchoolUNIVERSITY OF MINNESOTA
SourceDAI/B 69-09, p. , Nov 2008
Source TypeDissertation
SubjectsSocial psychology; Occupational psychology; Personality psychology; Quantitative psychology and psychometrics
Publication Number3324415
Adobe PDF Access the complete dissertation:
 

» Find an electronic copy at your library.
  Use the link below to access a full citation record of this graduate work:
  http://gateway.proquest.com/openurl%3furl_ver=Z39.88-2004%26res_dat=xri:pqdiss%26rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation%26rft_dat=xri:pqdiss:3324415
  If your library subscribes to the ProQuest Dissertations & Theses (PQDT) database, you may be entitled to a free electronic version of this graduate work. If not, you will have the option to purchase one, and access a 24 page preview for free (if available).

About ProQuest Dissertations & Theses
With over 2.3 million records, the ProQuest Dissertations & Theses (PQDT) database is the most comprehensive collection of dissertations and theses in the world. It is the database of record for graduate research.

The database includes citations of graduate works ranging from the first U.S. dissertation, accepted in 1861, to those accepted as recently as last semester. Of the 2.3 million graduate works included in the database, ProQuest offers more than 1.9 million in full text formats. Of those, over 860,000 are available in PDF format. More than 60,000 dissertations and theses are added to the database each year.

If you have questions, please feel free to visit the ProQuest Web site - http://www.proquest.com - or call ProQuest Hotline Customer Support at 1-800-521-3042.