Generalizability Theory I: Assessing Reliability of Observational Data in the Communication Sciences

O'Brian, Nigel; O'Brian, Sue; Packman, Ann; Onslow, Mark
June 2003
Journal of Speech, Language & Hearing Research;Jun2003, Vol. 46 Issue 3, p711
Academic Journal
Perceptual rating scales can be valid, reliable, and convenient tools for evaluating speech outcomes in research and clinical practice. However, they depend on the perceptions of observers. Too few raters may compromise accuracy, whereas too many would be inefficient. There is therefore a need to determine the minimum number of raters required for a reliable result. In this context, the ideas of Generalizability Theory have become increasingly popular in the behavioral sciences; suggestions have been made for their application to the assessment of speech-language disorders. Here we review the concepts involved, which are applied in a companion article dealing with speech naturalness data obtained from clients who recently completed treatment for their stuttering. We pay particular attention to the statistical requirements of the theory, including some cautions about possible inappropriate use of these techniques. We also offer a new interpretation of the results of the analysis that aims to be more meaningful to most speech-language pathologists.


Related Articles

  • Speech Therapy Corner. Garwood, Victor P. // Western Speech;Mar1955, Vol. 19 Issue 2, p73 

    Answers queries related to speech therapy. Utilization of psychoanalysis for adult stutterers; Importance of adequate courses in counseling in the training of public school speech correctionists; Suggestion on how public school administrators can be educated to distinguish a genuine clinical...

  • Therapy for Young Stutterers. Emerick, L. // Exceptional Children;Apr1965, Vol. 31 Issue 8, p398 

    Until recently therapy for young stutterers has been largely ignored. Public school speech therapists, confronted with the many problems these children present, struggle along as best they can by attempting to modify adult stuttering therapy to fit the children. This report presents a goal...

  • Toward a Discussion of Issues Associated With Speech-Language Pathologists' Dismissal Practices in Public School Settings. Steppling, Mary; Quattlebaum, Patricia; Brady, Debbie E. // Communication Disorders Quarterly;Spring2007, Vol. 28 Issue 3, p179 

    Guidelines for dismissal of a student who has been receiving educational interventions are available from both the American Speech-Language-Hearing Association (ASHA) Ad Hoc Committee on Admission/Discharge Criteria and from the Individuals with Disabilities Education Act (IDEA). Yet as...

  • The Use of Nonspeech Oral Motor Treatments for Developmental Speech Sound Production Disorders: Interventions and Interactions. Powell, Thomas W. // Language, Speech & Hearing Services in Schools;Jul2008, Vol. 39 Issue 3, p374 

    Purpose: The use of nonspeech oral motor treatments (NSOMTs) in the management of pediatric speech sound production disorders is controversial. This article serves as a prologue to a clinical forum that examines this topic in depth. Method: Theoretical, historical, and ethical issues are...

  • Nonspeech Oral Motor Treatment Issues Related to Children With Developmental Speech Sound Disorders. Ruscello, Dennis M. // Language, Speech & Hearing Services in Schools;Jul2008, Vol. 39 Issue 3, p380 

    Purpose: This article examines nonspeech oral motor treatments (NSOMTs) in the population of clients with developmental speech sound disorders. NSOMTs are a collection of onspeech methods and procedures that claim to influence tongue, lip, and jawresting postures; increase strength;...

  • A Nationwide Survey of Nonspeech Oral Motor Exercise Use: Implications for Evidence-Based Practice. Lof, Gregory L.; Watson, Maggie M. // Language, Speech & Hearing Services in Schools;Jul2008, Vol. 39 Issue 3, p392 

    Purpose: A nationwide survey was conducted to determine if speech-language pathologists (SLPs) use nonspeech oral motor exercises (NSOMEs) to address children's speech sound problems. For those SLPs who used NSOMEs, the survey also identified (a) the types of NSOMEs used by the SLPs, ( b) the...

  • An Integrated Evaluation of Nonspeech Oral Motor Treatments. Powell, Thomas W. // Language, Speech & Hearing Services in Schools;Jul2008, Vol. 39 Issue 3, p422 

    Purpose: This article functions as an epilogue to the clinical forum examining the use of nonspeech oral motor treatments (NSOMTs) to remediate speech sound disorders in children. Method: Conclusions to eight clinical questions are formed based on the findings that were reported in the clinical...

  • Feeding Tube Placement in Patients With Advanced Dementia: The Beliefs and Practice Patterns of Speech-Language Pathologists. Sharp, Helen M.; Shega, Joseph W. // American Journal of Speech-Language Pathology;Aug2009, Vol. 18 Issue 3, p222 

    Purpose: To describe the beliefs and practices of speech-language pathologists (SLPs) about the use of percutaneous endoscopic gastrostomy (PEG) among patients with advanced dementia and dysphagia. Method: A survey was mailed to a geographically stratified random sample of 1,050 medical SLPs....

  • Self-Rating of Stuttering Severity as a Clinical Tool. O'Brian, Sue; Packman, Ann; Onslow, Mark // American Journal of Speech-Language Pathology;Aug2004, Vol. 13 Issue 3, p219 

    Scaling is a convenient and equipment-free the SLP. For 8 of the 10 speakers, there was means for speech-language pathologists (SLP5) and clients to evaluate stuttering severity in everyday situations. This study investigated the extent to which the severity ratings of 10 adult stuttering...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics