Reliability of assessment of protein structure prediction methods

Marc A. Marti-Renom, M. S. Madhusudhan, András Fiser, Burkhard Rost, Andrej Sali

Research output: Contribution to journalArticlepeer-review

76 Scopus citations

Abstract

The reliability of ranking of protein structure modeling methods is assessed. The assessment is based on the parametric Student's t test and the nonparametric Wilcox signed rank test of statistical significance of the difference between paired samples. The approach is applied to the ranking of the comparative modeling methods tested at the fourth meeting on Critical Assessment of Techniques for Protein Structure Prediction (CASP). It is shown that the 14 CASP4 test sequences may not be sufficient to reliably distinguish between the top eight methods, given the model quality differences and their standard deviations. We suggest that CASP needs to be supplemented by an assessment of protein structure prediction methods that is automated, continuous in time, based on several criteria applied to a large number of models, and with quantitative statistical reliability assigned to each characterization.

Original languageEnglish (US)
Pages (from-to)435-440
Number of pages6
JournalStructure
Volume10
Issue number3
DOIs
StatePublished - 2002
Externally publishedYes

Keywords

  • CASP
  • Comparative protein structure modeling
  • EVA
  • Homology modeling
  • LiveBench
  • Model assessment
  • Statistical significance

ASJC Scopus subject areas

  • Structural Biology
  • Molecular Biology

Fingerprint Dive into the research topics of 'Reliability of assessment of protein structure prediction methods'. Together they form a unique fingerprint.

Cite this