Statistical Rigor in Operational Test and Evaluation: Success Stories and Future Challenges

• Activity Number: 225
• Type: Topic Contributed
• Date/Time: Monday, August 1, 2011 : 2:00 PM to 3:50 PM
• Sponsor: Section on Statistics in Defense and National Security
• Author(s): Catherine Warner*+
• Companies: Department of Defense
• Keywords: Operational Testing ; Department of Defense ; Design of Experiments

Abstract

The Director, Operational Test and Evaluation (DOT&E) is responsible for oversight of all Operational Tests and Evaluations within the Department of Defense. An operational field test is required before a Major Defense Acquisition Program can go into full-rate production. The Science Advisor's office is responsible for advising DOT&E on current, relevant scientific best practices. DOT&E has had a long standing relationship with the National Research Council's Committee on National Statistics. Recently, DOT&E, has pushed for the implementation of many recommendations of the committee including the use of Experimental Design in constructing operational tests. This talk covers examples where experimental design has improved operational test. Additionally, I propose areas for future statistical research based on challenges my office has encountered in the implementation of design of experiments to operational testing.