The development and validation of a quantitative imaging biomarker (QIB)-based model is riddled with pitfalls. A model developed using error-corrupted QIB measurements will have worse performance than one developed using error-free measurements. QIB model development is highly prone to overfitting, whether by the inclusion of too many QIBs in the model or by fitting an overly complex model form to the data. Improper model validation techniques often produce highly biased estimates of the model performance; even model validation using some proper techniques may lead to problems in small sample size scenarios.
An overview of the types of problems one may encounter during the development and validation of a QIB-based model is presented and demonstrated through simulation studies. Loose recommendations on model development and validation suggested by these results are then given.
|