Evaluating the Quality of Survey and Administrative Data with Generalized Multitrait-Multimethod Models

• Activity Number: 661
• Type: Contributed
• Date/Time: Thursday, August 4, 2016 : 8:30 AM to 10:20 AM
• Sponsor: Survey Research Methods Section
• Author(s): Daniel Oberski* and Antje Kirchner and Stephanie Eckman and Frauke Kreuter
• Companies: Tilburg University and University of Nebraska - Lincoln and RTI International and University of Maryland/University of Mannheim/German Federal Employment Agency
• Keywords: Measurement error ; Latent variable models ; Official statistics ; Register data ; Reliability ; Latent class models

Abstract

Administrative register data are increasingly important in statistics, but, like other types of data, may contain measurement errors. To prevent such errors from invalidating analyses of scientific interest, it is therefore essential to estimate the extent of measurement errors in administrative data. Currently, however, most approaches to evaluate such errors involve either prohibitively expensive audits or comparison with a survey that is assumed perfect.

We introduce the "generalized multitrait-multimethod" (GMTMM) model, which can be seen as a general framework for evaluating the quality of administrative and survey data simultaneously. This framework allows both survey and register to contain random and systematic measurement errors. Moreover, it accommodates common features of administrative data such as discreteness, nonlinearity, and nonnormality, improving similar existing models. The use of the GMTMM model is demonstrated by application to linked survey-register data from the German Federal Employment Agency on income from and duration of employment, and a simulation study evaluates the estimates obtained.