Trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school-based studies addressing weight-related issues

A literature review

Moonseong Heo, Singh R. Nair, Judith Wylie-Rosett, Myles S. Faith, Angelo Pietrobelli, Nancy R. Glassman, Sarah N. Martin, Stephanie Dickinson, David B. Allison

Research output: Contribution to journalReview article

1 Citation (Scopus)

Abstract

Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013-2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.

Original languageEnglish (US)
Article number8767315
JournalJournal of Obesity
Volume2018
DOIs
StatePublished - Jan 1 2018

Fingerprint

Weights and Measures
Cluster Analysis
Statistical Models
Random Allocation
PubMed
Sample Size

ASJC Scopus subject areas

  • Endocrinology, Diabetes and Metabolism

Cite this

Trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school-based studies addressing weight-related issues : A literature review. / Heo, Moonseong; Nair, Singh R.; Wylie-Rosett, Judith; Faith, Myles S.; Pietrobelli, Angelo; Glassman, Nancy R.; Martin, Sarah N.; Dickinson, Stephanie; Allison, David B.

In: Journal of Obesity, Vol. 2018, 8767315, 01.01.2018.

Research output: Contribution to journalReview article

@article{d33c44bc6b1b475e9b7718ea9f31e55e,
title = "Trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school-based studies addressing weight-related issues: A literature review",
abstract = "Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5{\%}) of studies incorporated ICC values for power analysis, fewer studies (8.3{\%}) reported the estimated ICC, and 68.6{\%} of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013-2017) compared to the prior years (74.1{\%} versus 63.5{\%}, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.",
author = "Moonseong Heo and Nair, {Singh R.} and Judith Wylie-Rosett and Faith, {Myles S.} and Angelo Pietrobelli and Glassman, {Nancy R.} and Martin, {Sarah N.} and Stephanie Dickinson and Allison, {David B.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1155/2018/8767315",
language = "English (US)",
volume = "2018",
journal = "Journal of Obesity",
issn = "2090-0708",
publisher = "Hindawi Publishing Corporation",

}

TY - JOUR

T1 - Trial characteristics and appropriateness of statistical methods applied for design and analysis of randomized school-based studies addressing weight-related issues

T2 - A literature review

AU - Heo, Moonseong

AU - Nair, Singh R.

AU - Wylie-Rosett, Judith

AU - Faith, Myles S.

AU - Pietrobelli, Angelo

AU - Glassman, Nancy R.

AU - Martin, Sarah N.

AU - Dickinson, Stephanie

AU - Allison, David B.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013-2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.

AB - Objective. To evaluate whether clustering effects, often quantified by the intracluster correlation coefficient (ICC), were appropriately accounted for in design and analysis of school-based trials. Methods. We searched PubMed and extracted variables concerning study characteristics, power analysis, ICC use for power analysis, applied statistical models, and the report of the ICC estimated from the observed data. Results. N=263 papers were identified, and N=121 papers were included for evaluation. Overall, only a minority (21.5%) of studies incorporated ICC values for power analysis, fewer studies (8.3%) reported the estimated ICC, and 68.6% of studies applied appropriate multilevel models. A greater proportion of studies applied the appropriate models during the past five years (2013-2017) compared to the prior years (74.1% versus 63.5%, p=0.176). Significantly associated with application of appropriate models were a larger number of schools (p=0.030), a larger sample size (p=0.002), longer follow-up (p=0.014), and randomization at a cluster level (p<0.001) and so were studies that incorporated the ICC into power analysis (p=0.016) and reported the estimated ICC (p=0.030). Conclusion. Although application of appropriate models has increased over the years, consideration of clustering effects in power analysis has been inadequate, as has report of estimated ICC. To increase rigor, future school-based trials should address these issues at both the design and analysis stages.

UR - http://www.scopus.com/inward/record.url?scp=85049825268&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049825268&partnerID=8YFLogxK

U2 - 10.1155/2018/8767315

DO - 10.1155/2018/8767315

M3 - Review article

VL - 2018

JO - Journal of Obesity

JF - Journal of Obesity

SN - 2090-0708

M1 - 8767315

ER -