SLE clinical trials: Impact of missing data on estimating treatment effects

Mimi Kim, Joan T. Merrill, Cuiling Wang, Shankar Viswanathan, Ken Kalunian, Leslie Hanrahan, Peter Izmirly

Research output: Contribution to journalArticle

Abstract

Objective A common problem in clinical trials is missing data due to participant dropout and loss to follow-up, an issue which continues to receive considerable attention in the clinical research community. Our objective was to examine and compare current and alternative methods for handling missing data in SLE trials with a particular focus on multiple imputation, a flexible technique that has been applied in different disease settings but not to address missing data in the primary outcome of an SLE trial. Methods Data on 279 patients with SLE randomised to standard of care (SoC) and also receiving mycophenolate mofetil (MMF), azathioprine or methotrexate were obtained from the Lupus Foundation of America-Collective Data Analysis Initiative Database. Complete case analysis (CC), last observation carried forward (LOCF), non-responder imputation (NRI) and multiple imputation (MI) were applied to handle missing data in an analysis to assess differences in SLE Responder Index-5 (SRI-5) response rates at 52 weeks between patients on SoC treated with MMF versus other immunosuppressants (non-MMF). Results The rates of missing data were 32% in the MMF and 23% in the non-MMF groups. As expected, the NRI missing data approach yielded the lowest estimated response rates. The smallest and least significant estimates of differences between groups were observed with LOCF, and precision was lowest with the CC method. Estimated between-group differences were magnified with the MI approach, and imputing SRI-5 directly versus deriving SRI-5 after separately imputing its individual components yielded similar results. Conclusion The potential advantages of applying MI to address missing data in an SLE trial include reduced bias when estimating treatment effects, and measures of precision that properly reflect uncertainty in the imputations. However, results can vary depending on the imputation model used, and the underlying assumptions should be plausible. Sensitivity analysis should be conducted to demonstrate robustness of results, especially when missing data proportions are high.

Original languageEnglish (US)
Article numbere000348
JournalLupus Science and Medicine
Volume6
Issue number1
DOIs
StatePublished - Oct 1 2019

Fingerprint

Mycophenolic Acid
Clinical Trials
Standard of Care
Observation
Azathioprine
Immunosuppressive Agents
Methotrexate
Uncertainty
Therapeutics
Databases
Research

Keywords

  • clinical trial
  • missing data
  • Systemic lupus erythematosus

ASJC Scopus subject areas

  • Immunology

Cite this

SLE clinical trials : Impact of missing data on estimating treatment effects. / Kim, Mimi; Merrill, Joan T.; Wang, Cuiling; Viswanathan, Shankar; Kalunian, Ken; Hanrahan, Leslie; Izmirly, Peter.

In: Lupus Science and Medicine, Vol. 6, No. 1, e000348, 01.10.2019.

Research output: Contribution to journalArticle

Kim, Mimi ; Merrill, Joan T. ; Wang, Cuiling ; Viswanathan, Shankar ; Kalunian, Ken ; Hanrahan, Leslie ; Izmirly, Peter. / SLE clinical trials : Impact of missing data on estimating treatment effects. In: Lupus Science and Medicine. 2019 ; Vol. 6, No. 1.
@article{99de33d2d3f14f868192d7de5e4aea5d,
title = "SLE clinical trials: Impact of missing data on estimating treatment effects",
abstract = "Objective A common problem in clinical trials is missing data due to participant dropout and loss to follow-up, an issue which continues to receive considerable attention in the clinical research community. Our objective was to examine and compare current and alternative methods for handling missing data in SLE trials with a particular focus on multiple imputation, a flexible technique that has been applied in different disease settings but not to address missing data in the primary outcome of an SLE trial. Methods Data on 279 patients with SLE randomised to standard of care (SoC) and also receiving mycophenolate mofetil (MMF), azathioprine or methotrexate were obtained from the Lupus Foundation of America-Collective Data Analysis Initiative Database. Complete case analysis (CC), last observation carried forward (LOCF), non-responder imputation (NRI) and multiple imputation (MI) were applied to handle missing data in an analysis to assess differences in SLE Responder Index-5 (SRI-5) response rates at 52 weeks between patients on SoC treated with MMF versus other immunosuppressants (non-MMF). Results The rates of missing data were 32{\%} in the MMF and 23{\%} in the non-MMF groups. As expected, the NRI missing data approach yielded the lowest estimated response rates. The smallest and least significant estimates of differences between groups were observed with LOCF, and precision was lowest with the CC method. Estimated between-group differences were magnified with the MI approach, and imputing SRI-5 directly versus deriving SRI-5 after separately imputing its individual components yielded similar results. Conclusion The potential advantages of applying MI to address missing data in an SLE trial include reduced bias when estimating treatment effects, and measures of precision that properly reflect uncertainty in the imputations. However, results can vary depending on the imputation model used, and the underlying assumptions should be plausible. Sensitivity analysis should be conducted to demonstrate robustness of results, especially when missing data proportions are high.",
keywords = "clinical trial, missing data, Systemic lupus erythematosus",
author = "Mimi Kim and Merrill, {Joan T.} and Cuiling Wang and Shankar Viswanathan and Ken Kalunian and Leslie Hanrahan and Peter Izmirly",
year = "2019",
month = "10",
day = "1",
doi = "10.1136/lupus-2019-000348",
language = "English (US)",
volume = "6",
journal = "Lupus Science and Medicine",
issn = "2053-8790",
publisher = "BMJ Publishing Group",
number = "1",

}

TY - JOUR

T1 - SLE clinical trials

T2 - Impact of missing data on estimating treatment effects

AU - Kim, Mimi

AU - Merrill, Joan T.

AU - Wang, Cuiling

AU - Viswanathan, Shankar

AU - Kalunian, Ken

AU - Hanrahan, Leslie

AU - Izmirly, Peter

PY - 2019/10/1

Y1 - 2019/10/1

N2 - Objective A common problem in clinical trials is missing data due to participant dropout and loss to follow-up, an issue which continues to receive considerable attention in the clinical research community. Our objective was to examine and compare current and alternative methods for handling missing data in SLE trials with a particular focus on multiple imputation, a flexible technique that has been applied in different disease settings but not to address missing data in the primary outcome of an SLE trial. Methods Data on 279 patients with SLE randomised to standard of care (SoC) and also receiving mycophenolate mofetil (MMF), azathioprine or methotrexate were obtained from the Lupus Foundation of America-Collective Data Analysis Initiative Database. Complete case analysis (CC), last observation carried forward (LOCF), non-responder imputation (NRI) and multiple imputation (MI) were applied to handle missing data in an analysis to assess differences in SLE Responder Index-5 (SRI-5) response rates at 52 weeks between patients on SoC treated with MMF versus other immunosuppressants (non-MMF). Results The rates of missing data were 32% in the MMF and 23% in the non-MMF groups. As expected, the NRI missing data approach yielded the lowest estimated response rates. The smallest and least significant estimates of differences between groups were observed with LOCF, and precision was lowest with the CC method. Estimated between-group differences were magnified with the MI approach, and imputing SRI-5 directly versus deriving SRI-5 after separately imputing its individual components yielded similar results. Conclusion The potential advantages of applying MI to address missing data in an SLE trial include reduced bias when estimating treatment effects, and measures of precision that properly reflect uncertainty in the imputations. However, results can vary depending on the imputation model used, and the underlying assumptions should be plausible. Sensitivity analysis should be conducted to demonstrate robustness of results, especially when missing data proportions are high.

AB - Objective A common problem in clinical trials is missing data due to participant dropout and loss to follow-up, an issue which continues to receive considerable attention in the clinical research community. Our objective was to examine and compare current and alternative methods for handling missing data in SLE trials with a particular focus on multiple imputation, a flexible technique that has been applied in different disease settings but not to address missing data in the primary outcome of an SLE trial. Methods Data on 279 patients with SLE randomised to standard of care (SoC) and also receiving mycophenolate mofetil (MMF), azathioprine or methotrexate were obtained from the Lupus Foundation of America-Collective Data Analysis Initiative Database. Complete case analysis (CC), last observation carried forward (LOCF), non-responder imputation (NRI) and multiple imputation (MI) were applied to handle missing data in an analysis to assess differences in SLE Responder Index-5 (SRI-5) response rates at 52 weeks between patients on SoC treated with MMF versus other immunosuppressants (non-MMF). Results The rates of missing data were 32% in the MMF and 23% in the non-MMF groups. As expected, the NRI missing data approach yielded the lowest estimated response rates. The smallest and least significant estimates of differences between groups were observed with LOCF, and precision was lowest with the CC method. Estimated between-group differences were magnified with the MI approach, and imputing SRI-5 directly versus deriving SRI-5 after separately imputing its individual components yielded similar results. Conclusion The potential advantages of applying MI to address missing data in an SLE trial include reduced bias when estimating treatment effects, and measures of precision that properly reflect uncertainty in the imputations. However, results can vary depending on the imputation model used, and the underlying assumptions should be plausible. Sensitivity analysis should be conducted to demonstrate robustness of results, especially when missing data proportions are high.

KW - clinical trial

KW - missing data

KW - Systemic lupus erythematosus

UR - http://www.scopus.com/inward/record.url?scp=85073711613&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073711613&partnerID=8YFLogxK

U2 - 10.1136/lupus-2019-000348

DO - 10.1136/lupus-2019-000348

M3 - Article

AN - SCOPUS:85073711613

VL - 6

JO - Lupus Science and Medicine

JF - Lupus Science and Medicine

SN - 2053-8790

IS - 1

M1 - e000348

ER -