TY - JOUR
T1 - Does response shift impact interpretation of change even among scales developed using item response theory?
AU - Schwartz, Carolyn E.
AU - Stucky, Brian D.
AU - Michael, Wesley
AU - Rapkin, Bruce D.
N1 - Publisher Copyright:
© 2020, The Author(s).
PY - 2020/12/1
Y1 - 2020/12/1
N2 - Background: Response-shift effects impact the interpretation of change in quality-of-life (QOL) measures developed with classical test theory (CTT) methods. This study evaluated the impact of response shift on measures developed using Item Response Theory (IRT), as compared to CTT. Methods: Chronically ill patients and caregivers (n = 1481) participated in a web-based survey at baseline and 17 months later. Patients completed the IRT-based PROMIS-10; NeuroQOL Applied Cognition, Positive Affect & Well-Being short-forms; and the CTT-based Ryff Environmental Mastery subscale. Response-shift effects were evaluated using regression residual modeling and the QOL Appraisal Profile-v2. The sample was divided into positive and negative catalyst groups on the basis of marital, work, job-status, and comorbidity change. Regression models predicted residualized QOL change scores as a function of catalysts and appraisal changes. Results: In this sample 859 (58%) reported a catalyst. No catalyst was associated with change in scales developed using IRT, but positive work change was associated with the CTT-based measure. Catalyst variables were associated with changes in appraisal, which in turn were related to all outcomes, particularly for global mental health after a positive work-change. Conclusions: Appraisal processes are relevant to interpreting IRT measures, particularly for global mental health in the face of life changes.
AB - Background: Response-shift effects impact the interpretation of change in quality-of-life (QOL) measures developed with classical test theory (CTT) methods. This study evaluated the impact of response shift on measures developed using Item Response Theory (IRT), as compared to CTT. Methods: Chronically ill patients and caregivers (n = 1481) participated in a web-based survey at baseline and 17 months later. Patients completed the IRT-based PROMIS-10; NeuroQOL Applied Cognition, Positive Affect & Well-Being short-forms; and the CTT-based Ryff Environmental Mastery subscale. Response-shift effects were evaluated using regression residual modeling and the QOL Appraisal Profile-v2. The sample was divided into positive and negative catalyst groups on the basis of marital, work, job-status, and comorbidity change. Regression models predicted residualized QOL change scores as a function of catalysts and appraisal changes. Results: In this sample 859 (58%) reported a catalyst. No catalyst was associated with change in scales developed using IRT, but positive work change was associated with the CTT-based measure. Catalyst variables were associated with changes in appraisal, which in turn were related to all outcomes, particularly for global mental health after a positive work-change. Conclusions: Appraisal processes are relevant to interpreting IRT measures, particularly for global mental health in the face of life changes.
KW - Appraisal
KW - Classical test theory
KW - Item response theory
KW - Life events
KW - Residual modeling
KW - Response shift
UR - http://www.scopus.com/inward/record.url?scp=85078160183&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85078160183&partnerID=8YFLogxK
U2 - 10.1186/s41687-019-0162-x
DO - 10.1186/s41687-019-0162-x
M3 - Article
AN - SCOPUS:85078160183
SN - 2509-8020
VL - 4
JO - Journal of Patient-Reported Outcomes
JF - Journal of Patient-Reported Outcomes
IS - 1
M1 - 8
ER -