An Examination of Reliability in Developmental Research

Kenneth J. Ottenbacher

Research output: Contribution to journalArticlepeer-review

19 Scopus citations


The purpose of this investigation was to examine quantitative methods used to determine reliability in developmental research. Procedures used to compute reliability estimates in 30 studies published in three developmental journals were examined. Four types of reliability studies were identified and analyzed. These included interrater reliability, stability (test-retest and intrarater reliability), equivalence reliability, and internal consistency. Interrater reliability investigations were the most frequently reported in the developmental literature reviewed (45%). The Pearson product moment correlation (r) was the most commonly reported reliability statistic. The findings reveal that researchers in developmental pediatrics frequently analyze reliability data using the Pearson product moment correlation and interpret the results as indicating consensus (agreement) among raters or across instruments. The Pearson product moment correlation (r) provides information on covariation among variables but does not indicate agreement. Thus, the findings suggest that developmental researchers may be misinterpreting the statistical results of reliability investigations. The argument is made that the intraclass correlation coefficient (ICC) is a more appropriate method of analysis when the purpose of the research is to examine consensus.

Original languageEnglish (US)
Pages (from-to)177-182
Number of pages6
JournalJournal of Developmental and Behavioral Pediatrics
Issue number3
StatePublished - Jun 1995
Externally publishedYes


  • consistency
  • data analysis
  • measurement

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health
  • Developmental and Educational Psychology
  • Psychiatry and Mental health


Dive into the research topics of 'An Examination of Reliability in Developmental Research'. Together they form a unique fingerprint.

Cite this