A comparison of visual analogue and numerical rating scale formats for the Lung Cancer Symptom Scale (LCSS)

Does format affect patient ratings of symptoms and quality of life?

P. J. Hollen, Richard J. Gralla, M. G. Kris, S. McCoy, G. W. Donaldson, C. M. Moinpour

Research output: Contribution to journalArticle

53 Citations (Scopus)

Abstract

Problem and Purpose: The Lung Cancer Symptom Scale (LCSS), a site-specific health-related quality of life measure for patients with lung cancer, was originally developed using a Visual Analogue Scale (VAS) format. However, the VAS format is not readily compatible with data management and software programs using scanning. The primary aim of this study was to evaluate the convergence of ratings obtained with a Numerical Rating Scale (NRS), with an 11-pt response category format, to those obtained with a VAS format. The intent was to determine the degree of agreement between two formats to generalize the existing psychometric properties for the original measure to the new presentation. Design/setting: This methodological study evaluated the feasibility, reliability, and validity of a NRS format for the LCSS. The study was conducted at two cancer centers in New York City. Patients/procedures: Sixty-eight patients with non-small cell lung cancer (NSCLC) completed both versions of the LCSS along with demographic and feasibility questions on a single occasion. The VAS form was administered first, followed by the NRS form to prevent bias. The intraclass correlation coefficient (ICC), Lin's concordance correlation coefficient (CCC), and Bland-Altman plots were used to evaluate agreement and to characterize bias. Results: Cronbach's alpha for the NRS format total score was 0.89 for the 68 patients with NSCLC. Agreement was excellent, with both the ICC and CCC 0.90 for the two summary scores (total score and average symptom burden index) for the LCSS. Only five of the nine individual items showed this level of strict agreement. An agreement criterion of 0.80 (representing excellent) was observed for seven of the nine individual items (all but appetite loss and hemoptysis). Mean differences tended to be slightly lower for the VAS format compared to the NRS format (more so for the appetite and hemoptysis items), with evidence of scale shift for the same two items. The summary measures showed good concordance as measured by the ICC and CCC, but did display mean differences (VAS - NRS) of -2.7 and -3.1, respectively. Conclusions: Overall, the NRS format for the LCSS suitable for scanning has good feasibility, reliability (internal consistency), and convergent validity. The complete set of concordance evaluation measures supports the reproducibility of VAS scores by NRS scores, particularly for the two summary scores.

Original languageEnglish (US)
Pages (from-to)837-847
Number of pages11
JournalQuality of Life Research
Volume14
Issue number3
DOIs
StatePublished - Apr 2005
Externally publishedYes

Fingerprint

Visual Analog Scale
Lung Neoplasms
Quality of Life
Hemoptysis
Appetite
Non-Small Cell Lung Carcinoma
Psychometrics
Reproducibility of Results
Software
Demography
Neoplasms

Keywords

  • Lung Cancer Symptom Scale
  • Numerical Rating Scale
  • Visual Analogue Scale

ASJC Scopus subject areas

  • Rehabilitation
  • Nursing(all)

Cite this

A comparison of visual analogue and numerical rating scale formats for the Lung Cancer Symptom Scale (LCSS) : Does format affect patient ratings of symptoms and quality of life? / Hollen, P. J.; Gralla, Richard J.; Kris, M. G.; McCoy, S.; Donaldson, G. W.; Moinpour, C. M.

In: Quality of Life Research, Vol. 14, No. 3, 04.2005, p. 837-847.

Research output: Contribution to journalArticle

@article{e5339068634a46acb6134a29da96c342,
title = "A comparison of visual analogue and numerical rating scale formats for the Lung Cancer Symptom Scale (LCSS): Does format affect patient ratings of symptoms and quality of life?",
abstract = "Problem and Purpose: The Lung Cancer Symptom Scale (LCSS), a site-specific health-related quality of life measure for patients with lung cancer, was originally developed using a Visual Analogue Scale (VAS) format. However, the VAS format is not readily compatible with data management and software programs using scanning. The primary aim of this study was to evaluate the convergence of ratings obtained with a Numerical Rating Scale (NRS), with an 11-pt response category format, to those obtained with a VAS format. The intent was to determine the degree of agreement between two formats to generalize the existing psychometric properties for the original measure to the new presentation. Design/setting: This methodological study evaluated the feasibility, reliability, and validity of a NRS format for the LCSS. The study was conducted at two cancer centers in New York City. Patients/procedures: Sixty-eight patients with non-small cell lung cancer (NSCLC) completed both versions of the LCSS along with demographic and feasibility questions on a single occasion. The VAS form was administered first, followed by the NRS form to prevent bias. The intraclass correlation coefficient (ICC), Lin's concordance correlation coefficient (CCC), and Bland-Altman plots were used to evaluate agreement and to characterize bias. Results: Cronbach's alpha for the NRS format total score was 0.89 for the 68 patients with NSCLC. Agreement was excellent, with both the ICC and CCC 0.90 for the two summary scores (total score and average symptom burden index) for the LCSS. Only five of the nine individual items showed this level of strict agreement. An agreement criterion of 0.80 (representing excellent) was observed for seven of the nine individual items (all but appetite loss and hemoptysis). Mean differences tended to be slightly lower for the VAS format compared to the NRS format (more so for the appetite and hemoptysis items), with evidence of scale shift for the same two items. The summary measures showed good concordance as measured by the ICC and CCC, but did display mean differences (VAS - NRS) of -2.7 and -3.1, respectively. Conclusions: Overall, the NRS format for the LCSS suitable for scanning has good feasibility, reliability (internal consistency), and convergent validity. The complete set of concordance evaluation measures supports the reproducibility of VAS scores by NRS scores, particularly for the two summary scores.",
keywords = "Lung Cancer Symptom Scale, Numerical Rating Scale, Visual Analogue Scale",
author = "Hollen, {P. J.} and Gralla, {Richard J.} and Kris, {M. G.} and S. McCoy and Donaldson, {G. W.} and Moinpour, {C. M.}",
year = "2005",
month = "4",
doi = "10.1007/s11136-004-0833-8",
language = "English (US)",
volume = "14",
pages = "837--847",
journal = "Quality of Life Research",
issn = "0962-9343",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - A comparison of visual analogue and numerical rating scale formats for the Lung Cancer Symptom Scale (LCSS)

T2 - Does format affect patient ratings of symptoms and quality of life?

AU - Hollen, P. J.

AU - Gralla, Richard J.

AU - Kris, M. G.

AU - McCoy, S.

AU - Donaldson, G. W.

AU - Moinpour, C. M.

PY - 2005/4

Y1 - 2005/4

N2 - Problem and Purpose: The Lung Cancer Symptom Scale (LCSS), a site-specific health-related quality of life measure for patients with lung cancer, was originally developed using a Visual Analogue Scale (VAS) format. However, the VAS format is not readily compatible with data management and software programs using scanning. The primary aim of this study was to evaluate the convergence of ratings obtained with a Numerical Rating Scale (NRS), with an 11-pt response category format, to those obtained with a VAS format. The intent was to determine the degree of agreement between two formats to generalize the existing psychometric properties for the original measure to the new presentation. Design/setting: This methodological study evaluated the feasibility, reliability, and validity of a NRS format for the LCSS. The study was conducted at two cancer centers in New York City. Patients/procedures: Sixty-eight patients with non-small cell lung cancer (NSCLC) completed both versions of the LCSS along with demographic and feasibility questions on a single occasion. The VAS form was administered first, followed by the NRS form to prevent bias. The intraclass correlation coefficient (ICC), Lin's concordance correlation coefficient (CCC), and Bland-Altman plots were used to evaluate agreement and to characterize bias. Results: Cronbach's alpha for the NRS format total score was 0.89 for the 68 patients with NSCLC. Agreement was excellent, with both the ICC and CCC 0.90 for the two summary scores (total score and average symptom burden index) for the LCSS. Only five of the nine individual items showed this level of strict agreement. An agreement criterion of 0.80 (representing excellent) was observed for seven of the nine individual items (all but appetite loss and hemoptysis). Mean differences tended to be slightly lower for the VAS format compared to the NRS format (more so for the appetite and hemoptysis items), with evidence of scale shift for the same two items. The summary measures showed good concordance as measured by the ICC and CCC, but did display mean differences (VAS - NRS) of -2.7 and -3.1, respectively. Conclusions: Overall, the NRS format for the LCSS suitable for scanning has good feasibility, reliability (internal consistency), and convergent validity. The complete set of concordance evaluation measures supports the reproducibility of VAS scores by NRS scores, particularly for the two summary scores.

AB - Problem and Purpose: The Lung Cancer Symptom Scale (LCSS), a site-specific health-related quality of life measure for patients with lung cancer, was originally developed using a Visual Analogue Scale (VAS) format. However, the VAS format is not readily compatible with data management and software programs using scanning. The primary aim of this study was to evaluate the convergence of ratings obtained with a Numerical Rating Scale (NRS), with an 11-pt response category format, to those obtained with a VAS format. The intent was to determine the degree of agreement between two formats to generalize the existing psychometric properties for the original measure to the new presentation. Design/setting: This methodological study evaluated the feasibility, reliability, and validity of a NRS format for the LCSS. The study was conducted at two cancer centers in New York City. Patients/procedures: Sixty-eight patients with non-small cell lung cancer (NSCLC) completed both versions of the LCSS along with demographic and feasibility questions on a single occasion. The VAS form was administered first, followed by the NRS form to prevent bias. The intraclass correlation coefficient (ICC), Lin's concordance correlation coefficient (CCC), and Bland-Altman plots were used to evaluate agreement and to characterize bias. Results: Cronbach's alpha for the NRS format total score was 0.89 for the 68 patients with NSCLC. Agreement was excellent, with both the ICC and CCC 0.90 for the two summary scores (total score and average symptom burden index) for the LCSS. Only five of the nine individual items showed this level of strict agreement. An agreement criterion of 0.80 (representing excellent) was observed for seven of the nine individual items (all but appetite loss and hemoptysis). Mean differences tended to be slightly lower for the VAS format compared to the NRS format (more so for the appetite and hemoptysis items), with evidence of scale shift for the same two items. The summary measures showed good concordance as measured by the ICC and CCC, but did display mean differences (VAS - NRS) of -2.7 and -3.1, respectively. Conclusions: Overall, the NRS format for the LCSS suitable for scanning has good feasibility, reliability (internal consistency), and convergent validity. The complete set of concordance evaluation measures supports the reproducibility of VAS scores by NRS scores, particularly for the two summary scores.

KW - Lung Cancer Symptom Scale

KW - Numerical Rating Scale

KW - Visual Analogue Scale

UR - http://www.scopus.com/inward/record.url?scp=17744378244&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=17744378244&partnerID=8YFLogxK

U2 - 10.1007/s11136-004-0833-8

DO - 10.1007/s11136-004-0833-8

M3 - Article

VL - 14

SP - 837

EP - 847

JO - Quality of Life Research

JF - Quality of Life Research

SN - 0962-9343

IS - 3

ER -