Novel Application of Statistical Tools for Big Data Analyses of Solar Physics

• Activity Number: 129
• Type: Contributed
• Date/Time: Monday, August 10, 2015 : 8:30 AM to 10:20 AM
• Sponsor: Section on Statistics and the Environment
• Author(s): Siavoush Mohammadi and Lars K.S. Daldorff*
• Companies: Infotrek and University of Michigan/NASA GSFC
• Keywords: plasma physics ; SAS VA ; data extraction ; big data ; graphical visualization ; high performance computing

Abstract

Space plasma simulations are known to generate vast amounts of numerical data. In recent times,with greater availability of computer power, the proportion of data generated has increased exponentially posing new challenges in its analyses. Simulations can be scaled up, but matching methods for analyses have not been developed at the same pace, except in the industry setting where companies utilize big-data techniques to build advanced analyses engines. Although many of these methods need developers working with low-level big-data programming, today there exist powerful out-of-the box solutions that can be easily employed. In this paper, using SAS Visual Analytics as one of these tools, we will demonstrate how existing statistical tools and analytical platforms can be used to analyse simulations of the Sun in a novel way. In ours case, simulations will generate roughly 660mb/time unit and hundreds of them are needed to provide an adequate analyses. Application of our method thus allows instant analyses and prevents the need to guess "when" and "where" the interesting physical phenomena occur, thus effectively getting rid of data which has little or no scientific value.