JSM 2011 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

My Program

Abstract Details

Activity Number: 661
Type: Contributed
Date/Time: Thursday, August 4, 2011 : 10:30 AM to 12:20 PM
Sponsor: Section on Statistical Computing
Abstract - #301473
Title: Bootstraps, Permutation Tests, and Sampling with and Without Replacement Orders of Magnitude Faster Using SAS®
Author(s): John Douglas Opdyke*+
Companies: DataMineIt
Address: 17 McKinley Road, Marblehead, MA, 01945, US
Keywords: Bootstrap ; Permutation ; SAS ; Scalable ; Sampling ; Replacement
Abstract:

A very efficient approach to random sampling in SAS® achieves speed increases orders of magnitude faster than the relevant "built-in" SAS® procedures. For sampling with replacement as applied to bootstraps, seven algorithms are compared, and the fastest ("OPDY"), based on the new approach, achieves speed increases over 220x faster than Proc SurveySelect. OPDY also handles datasets many times larger than those on which two hashing algorithms crash. For sampling without replacement as applied to permutation tests, six algorithms are compared, and the fastest ("OPDN"), based on the new approach, achieves speed increases over 215x faster than Proc SurveySelect, over 350x faster than NPAR1WAY (which crashes on datasets less than a tenth the size OPDN can handle), and over 720x faster than Proc Multtest. OPDN utilizes a simple draw-by-draw procedure that allows for the repeated creation of many without-replacement permutation samples without requiring any additional storage or memory space. Based on these results, there appear to be no faster or more scalable algorithms in SAS® for bootstraps, permutation tests, or sampling with or without replacement.


The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2011 program




2011 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.