The Communicative Effectiveness Survey: investigating its item-level psychometric properties

Citation metadata

Authors: Neila J. Donovan, Craig A. Velozo and John C. Rosenbek
Date: Dec. 2007
From: Journal of Medical Speech - Language Pathology(Vol. 15, Issue 4)
Publisher: Delmar Learning
Document Type: Survey
Length: 6,735 words
Article Preview :

The study's purpose was to investigate the item-level psychometric properties of the Communicative Effectiveness Survey (CES) using Rasch analysis, an item response theory model. The CES (8-item 7-category rating scale) was designed to elicit ratings of communicative effectiveness in everyday situations from individuals with dysarthria. A speech-language pathologist (SLP) blind to the study's purpose administered the CES to 95 individuals (58% male), mean age 62.5 (SD = 14.0, range 18-87), with neurodegenerative diseases and a wide range of speech competency. Rasch analysis showed three of the seven rating scale categories were used with such low statistical probability that they were not useful. All subsequent analyses used the 4-category rating scale. Twelve participants (five males, seven females; eight with Parkinson's disease, four with other neurodegenerative diseases) demonstrated erratic response patterns and were removed from analysis. Positive item-level psychometric properties of the CES included: (1) item hierarchy conformed to an a priori theoretical hierarchy (indicator of content validity); (2) principal components analysis showed that the items represented a unidimensional construct; (3) 3.92 statistically significant ability levels; and (4) high person-to-measure consistency of 0.94 (analogous to Cronbach's alpha). We suggest that the CES could be used to add an additional dimension to a clinician's repertoire of pre- and posttreatment outcome measures.


Researchers and clinicians increasingly recognize that the patient perspective is essential in understanding health status and healthcare (Arpinelli & Bamfi, 2006). Instruments that assess the patient perspective are referred to as "patient-reported outcomes" (PROs) (Arpinelli & Bamfi, 2006; Fries, Bruce, Bjorner, & Rose, 2007; Willke, Burke, & Erickson, 2004). PROs provide important information from the patient's perspective that might be lost otherwise. For example, some treatment effects can only be perceived by the patient, or treatment effects demonstrated from standardized assessments or physiologic measures may not correspond to changes perceived by the patient. In addition, PROs reduce the risk of interobserver bias or variability that may occur when patient responses are filtered through a clinician (FDA, 2006). Currently, the National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) is in the process of developing PROs to be used as outcome measures in clinical treatment trials for many chronic illnesses (Fries et al., 2007). As with any diagnostic instrument, the conceptual development of a PRO must be sound, and it must have demonstrated validity and reliability before it can be used with confidence (Coyne, Tubaro, Brubaker, & Bavendam, 2006; FDA, 2006; Fries et al., 2007; Ross, 2006).

Researchers and clinicians in the field of communicative disorders (CD) have a need for measures that describe the patient's communication status from the patient's perspective. In the treatment of dysarthria, adding a PRO to the traditional assessment battery may provide clinicians with a more complete picture of the patient's condition before treatment, assist in determining optimal treatment, demonstrate the outcomes of the treatments, and justify what more needs to be done. One such instrument under development is the Communicative Effectiveness Survey (CES; Yorkston, Beukelman, Strand, & Bell, 1999), a patient-reported outcome measure of communicative...

Main content

Source Citation

Source Citation
Donovan, Neila J., et al. "The Communicative Effectiveness Survey: investigating its item-level psychometric properties." Journal of Medical Speech - Language Pathology, vol. 15, no. 4, 2007, p. 433+. Accessed 6 Apr. 2020.

Gale Document Number: GALE|A172803452