E-Module (SSA)

SECTION 5.3:
How do rehabilitation providers know if an outcome measure will be useful in practice?

Measurement propertiesare characteristics of a measure that can help determine whether the measure will be suitable for use in practice. There are four main measurement properties commonly seen in the literature (see Table 5.3)

Table 5.3: Descriptions of Measurement Properties

Measurement Property Description

Reliability

Degree of consistency of the measure and whether a measure (or questionnaire) is free from error. 12 (Waltz et al., 2010; Polit & Beck 2008)

It is important that measures are reliable (or consistent) and able to differentiate measure scores between clients.

Validity

How well the measure really measures what it is supposed to measure 13 (Lam et al., 2010; Polit & Beck, 2008)

For example, does the HIV Symptom Index, 14 developed to measure symptom presence and severity, really measure this construct or are there other HIV symptoms that people living with HIV might experience not captured in this questionnaire?

Responsiveness

Ability for a measure to detect change in a client over time if a change has occurred. 15 This property is relevant to evaluative types of measures.

A sensitive, or responsive assessment enables the healthcare provider to detect small to large changes in the construct of interest.

For example, a rehabilitation provider might be interested in knowing whether participation in a six week aerobic exercise program has an impact on the Health-Related Quality of Life of a client. 

Interpretability

Meaning of the scores or values associated with the outcome measures – what do the numbers really mean?

For example, what does a score of 82 on the Mental Health Summary Score of the Medical Outcomes Study Short Form (SF-36) 16 , 17 mean for clients? What does it mean for treatment decisions in clinical practice?

Terms such as the minimal detectable change (MDC), or minimal clinically important difference (MCID) refer to interpretability, specifically the minimum score that reflects an important or clinical change (improvement or worsening) for a given measure. 18 , 19

For example, the MCID for the six-minute walk test is 25 meters among people living with Chronic Obstructive Pulmonary Disease. 20 If an individual improves his/her score on the test by 30 metres, this can be interpreted as a clinically important improvement in functional capacity.

Often measures do not have a clear MCID or MDC and rehabilitation providers are left trying to interpret what the scores on a given measure mean to specific clients and what the scores mean for decision making in clinical practice.

16 Streiner DL, Norman GR. Health Measurement Scales - A practical guide to their development and use. 4th ed. New York: Oxford University Press. 2008.

17 Nunnally JC, Bernstein IH. Psychometric Theory. 3rd Ed. New York: McGraw Hill, 1994.

18 Justice AC, Holmes W, Gifford AL, Rabeneck L, Zackin R, Sinclair G, Weissman S, Neidig J, Marcus C, Chesney M, Cohn SE, Wu AW; Adult AIDS Clinical Trials Unit Outcomes Committee. Development and validation of a self-completed HIV symptom index. J Clin Epidemiol. 2001 Dec;54 Suppl 1:S77-90. PubMed PMID: 11750213. http://www.ncbi.nlm.nih.gov/pubmed/11750213 .

19 Ware JE Jr. SF-36 health survey update. Spine (Phila Pa 1976). 2000 Dec 15;25(24):3130-9. Review. PubMed PMID: 11124729. http://www.ncbi.nlm.nih.gov/pubmed/11124729 .

20 Ware JE Jr, Gandek B. Overview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project. J Clin Epidemiol. 1998  Nov;51(11):903-12. PubMed PMID: 9817107. http://www.ncbi.nlm.nih.gov/pubmed/9817107 .

21 Beaton DE, Boers M, Wells GA. Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. Curr Opin Rheumatol. 2002 Mar;14(2):109-14. Review. PubMed PMID: 11845014. http://www.ncbi.nlm.nih.gov/pubmed/11845014 .

22 Holland AE, Hill CJ, Rasekaba T, Lee A, Naughton MT, McDonald CF. Updating the minimal important difference for six-minute walk distance in patients with chronic obstructive pulmonary disease. Arch Phys Med Rehabil. 2010 Feb;91(2):221-5. doi: 10.1016/j.apmr.2009.10.017. PubMed PMID: 20159125. http://www.ncbi.nlm.nih.gov/pubmed/20159125 .

View Site in Mobile | Classic
Share by: