Abstract:
|
When sample sizes are small, the ability to identify weak (but scientifically interesting) associations between a set of predictors and a response may be enhanced by pooling existing datasets. But variations in acquisition methods and the distribution of participants or observations between datasets, especially due to the distributional shifts in some predictors, may obfuscate real effects when datasets are combined. We present a rigorous statistical treatment of this problem and identify conditions when we can correct the distributional shift. We also provide an algorithm for the situation where the correction is identifiable, which depends on maximum mean discrepancy and has relation with generative adversarial network. We analyze various properties of the framework for testing model fit, constructing confidence intervals and evaluating consistency characteristics. Our technical development is motivated by Alzheimer's disease (AD) studies and we present empirical results showing that our framework enables harmonizing protein biomarkers even when the assays across sites differ.
|