Online Program Home
  My Program

Abstract Details

Activity Number: 241 - Section on Statistics in Defense and National Security CPapers 1
Type: Contributed
Date/Time: Monday, July 31, 2017 : 2:00 PM to 3:50 PM
Sponsor: Section on Statistics in Defense and National Security
Abstract #323824 View Presentation
Title: Users Are Part of the System: How to Account for Human Factors When Designing Operational Tests for Software Systems
Author(s): Kelly McGinnity* and Heather Wojton
Companies: Institute for Defense Analyses and Institute for Defense Analyses
Keywords: Design of experiments ; Software testing ; Human factors ; Operational test ; Policy
Abstract:

The Director, Operational Test and Evaluation (DOT&E) has issued several policy memos emphasizing statistical rigor in test planning and data analysis, including the use of design of experiments (DOE) principles, and smart survey design and administration. Oftentimes, particularly when testing software-intensive systems, it is necessary to account for both engineering and human factors simultaneously in order to facilitate a complete and operationally realistic evaluation of the system. While some software systems may inherently be deterministic in nature, once placed in their intended environment with error-prone humans and highly stochastic networks, variability in outcomes can, and often does, occur. This talk will briefly discuss best practices and design options for including the user in the DOE, and present a real-world example.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2017 program

 
 
Copyright © American Statistical Association