Online Program

All standard regression models have assumptions that must be verified for the model to have power to test hypotheses and for it to be able to predict accurately. Of the principal assumptions (linearity, additivity, distributional), this course will emphasize methods for assessing and satisfying the first two. Practical but powerful tools are presented for validating model assumptions and presenting model results. This course provides methods for estimating the shape of the relationship between predictors and response using the widely applicable method of augmenting the design matrix using restricted cubic splines. Even when assumptions are satisfied, overfitting can ruin a model's predictive ability for future observations. Methods for data reduction will be introduced to deal with the common case where the number of potential predictors is large in comparison with the number of observations. Methods of model validation (bootstrap and cross-validation) will be covered, as will auxiliary topics such as modeling interaction surfaces, variable selection, overly influential observations, collinearity, and shrinkage, and a brief introduction to the R rms package for handling these problems. The methods covered will apply to almost any regression model, including ordinary least squares, logistic regression models, ordinal regression, quantile regression, longitudinal data analysis, and survival models.

Outline & Objectives

1. Introduction; Advantages of prediction over classication
2. Hypothesis Testing vs. Estimation vs. Prediction vs. Classication
3. How Many Degrees of Freedom does a Data Mining Procedure Ac-
tually Have?
4. Regression Model Notation
5. Model Formulations
6. Interpreting Model Parameters
(a) Nominal Predictors
(b) Interactions
7. Relaxing Linearity Assumption for Continuous Predictors
(a) Categorization is not an alternative
(b) Simple Nonlinear Terms
(c) Splines for Estimating Shape of Regression Function and Deter-
mining Predictor Transformations
(d) Cubic Spline Functions
(e) Restricted Cubic Splines
(f) Choosing Number and Position of Knots
(g) Nonparametric smoothers and regression trees
(h) Advantages of Splines over Other Methods
8. Multiple Degree of Freedom Tests of Association
9. Assessment of Model Fit
(a) Regression Assumptions
(b) Modeling and Testing Interactions
10. Multivariable Modeling Strategy
(a) Why and How To Pre-specify Model Complexity
(b) Problems Caused by Ordinary Stepwise Variable Selection
(c) Collinearity
(d) Shrinkage
(e) Data Reduction
(f) Overly In uential Observations
(g) Some Useful Modeling Strategies for
i. Prediction
ii. Estimation
iii. Hypothesis Testing
11. Overview of the Bootstrap
12. Model Validation
(a) Cross-validation
(b) Bootstrap
13. Graphical Methods for Interpreting Complex Regression Fits
14. Detailed Case Studies
(a) Generalized Least Squares for Serial Data
(b) Ordinal Regression for Continuous Y : Predicting glycohemoglobin
(and pre-diabetes) from body size characteristics using NHANES
data
(c) Binary Logistic Regression: Survival Patterns of Passengers on
the Titanic
(d) Survival Modeling
A more detailed outline is available at biostat.mc.vanderbilt.edu/rms.

About the Instructor

Dr. Harrell is Professor of Biostatistics, Founding Chair of the
Department of Biostatistics of Vanderbilt University School of Medicine, and Expert Statistical Advisor, Oce of Biostatistics, Center for Drug
Evaluation and Research, US FDA. Prior to starting the new department
in 2003 he was Chief of the Division Biostatistics and Epidemiology in the
Department of Health Evaluation Sciences, University of Virginia School
of Medicine. Prior to coming to the University of Virginia in 1996 he
was in the Division of Biometry at Duke University Medical Center for 17
years. He received his Ph.D. in biostatistics from the University of North
Carolina, Chapel Hill in 1979, where he studied under P.K. Sen. Dr.
Harrell's interests include statistical modeling and model validation, sta-
tistical computing and graphics, reproducible research, survival analysis,
clinical trials, health services and outcomes research, medical diagnostic
and prognostic models, bootstrapping, missing data, and Bayesian mod-
eling. He is an associate editor of Statistics in Medicine, a member of
the editorial board for American Heart Journal, a member of Faculty of
1000 Medicine, on the editorial policy board for the Journal of Clinical
Epidemiology and a member of the Scientic Advisory Board, for Science
Translational Medicine. For many years he has been a consultant to FDA
and the pharmaceutical industry. He is author of the book Regression
Modeling Strategies, Second Edition (Springer, 2015) and teaches courses
in biostatistical modeling. He was the recipient of the American Statisti-
cal Association's WJ Dixon award for excellence in statistical consulting
in 2014.

Relevance to Conference Goals

This is an applied statistics course that teaches regression analysis and predictive modeling tools that have wide applicability, and should be of great value to almost all practicing statisticians.

With recent big data, data science and deep learning revolution, enterprises ranging from FORTUNE 100 to startups across the world are hungry for data scientists and machine learning scientists to bring actionable insight from the vast amount of data collected. In the past a couple of years, deep learning has gained traction in many application areas and it becomes an essential tool in data scientist’s toolbox. In this course, students will develop a clear understanding of the big data cloud platform, technical skills in data sciences and machine learning, and especially the motivation and use cases of deep learning through hands-on exercises. We will also cover the “art” part of data science and machine learning to guide participants to learn typical agile data science project flow, general pitfalls in data science and machine learning, and soft skills to effectively communicate with business stakeholders. This course will prepare statisticians to be successful data scientists and deep learning scientist in various industries and business sectors.

Outline & Objectives

The big data platform, data science, and deep learning overviews are specifically designed for audience with statistics education background. The data science workflow, pitfalls and soft skills are highlight through real-world data science and machine learning problems. The Databricks community edition cloud platform will be used throughout the training course to cover hands-on sessions including: (1) big data platform using Spark through R sparklyr package; (2) introduction to Deep Neural Network, Convolutional Neural Network and Recurrent Neural Networks and their applications; (3) deep learning examples using TensorFlow through R keras package. The primary audiences for this course are: (1) statistician in traditional industry sectors such as manufacturing, pharmaceutical and banking; (2) statistician in government agencies; (3) statistical researchers in universities; (4) graduate students in statistics departments. The prerequisite knowledge is MS level education in statistics and entry level of R knowledge. No software installation is needed in students’ laptop and the cloud platform is easily accessed through browsers such as Chrome or Firefox with internet connection.

About the Instructor

Both instructors have Ph.D. in Statistics from Iowa State University and have worked in data science and machine learning areas for a number of years. Dr. Li is a Sr. Data Scientist at Amazon and Dr. Lin is a Data Scientist at Netlify. Before Amazon, Dr. Li was at Walmart, SAS and GE and he was the Chair of the 2017 Quality and Productivity Section of ASA. Dr. Lin was a leader at DuPont on applying advanced data science to enhance marketing and sales effectiveness and she is the co-founder of Central Iowa R User Group and blogger of scientistcafe.com. With deep statistics background and a few years’ industrial experiences in data science, they have trained and mentored numerous junior data scientist with diversified background. They have taught a similar continue education course without the deep learning part at the 2017 JSM, and they will teach similar courses at Joint Research Conference, ICSA Applied Statistics Symposium and Fall Technical Conference in 2018. Dr. Li organized and will present at the Introductory Overview Lecture “Leading Data Science: Talent, Strategy, and Impact” at the 2018 JSM. Dr. Li is also an Instructor of Amazon’s internal Machine Learning University.

Relevance to Conference Goals

This short course fit the conference goals very well. It focuses on Big Data and Data Science applications in real-world problems including the new development of deep learning. With the focus on the cloud platform, students can learn the current trend of data science software and big data infrastructure used by tech companies such that they can expand their programming scope to cover more applications in data science and machine learning. The short course also includes the needed soft-skill discussions to prepare students with better understanding of the data science project flow, pitfalls in machine learning and communication skills. This course keeps statistician’s background in mind to bridge the gaps between a traditional statistician and a successful data scientist. After taking the course, students will be confident to positively impact their organization by transforming their current traditional statistics team into a data science or machine learning team or to explore data scientist or machine learning scientist opportunities for their future career development.

This seminar is a practical introduction to and an overview of the techniques and strategies of data mining. While I will discuss the models in detail, the course will be application rather than theoretically oriented. Many of the standard techniques of data mining, including modern model selection strategies for multiple regression such as the lasso, elastic net etc will be presented. In addition we'll cover classification and regression trees, neural networks, principal components, Naïve Bayes, bagging, and boosting. The course will be problem solving based, using real case studies from science and industry to illustrate which methods work well, when and why. We will emphasize problem formulation, the challenges of the process and the communication that is necessary back to decision makers to effect maximum impact in the organization. No prerequisites other that a knowledge of the basics of regression are assumed. The applications will come from a wide variety of industries and include some applications from my personal experiences as a consultant for companies that deal with such topics as financial services, chemical processing, pharmaceuticals, and insurance.

Outline & Objectives

Outline:
I. Introduction to data mining a. What is data mining? b. What are the applications? c. How does it differ from statistics? 2. Formulating the problem a. Data considerations b. How to evaluate the methods c. Testing and training 3. The methods -- overview of the most commonly used algorithms use 4. Case studies a. In depth comparisons of the methods and how they helped solve the problem b. Challenges to communication 5. Summary

Learning Objectives
(a) Learning outcomes (performance objectives): In the process of analyzing the data sets, attendees will learn how to: • Identify appropriate problems for data mining • Learn how to explore and prepare data for mining • Use a variety of techniques including decision trees and neural nets to build accurate predictive models • Evaluate the quality of models • Select the appropriate data mining tools for applications. (b) Content and instructional methods: The presentation provides interaction between the participant and the material by involving audience participation in the data analyses.

About the Instructor

Richard De Veaux (Dick), Ph.D is C. Carlise and Margaret Tippit Professor of Statistics at Williams College. He holds degrees in Civil Engineering (B.S.E. Princeton), Mathematics (A.B. Princeton), Dance Education (M.A.) and Statistics (Ph.D.) at Stanford where he studied statistics with Persi Diaconis and dance with Inga Weiss. Dick has taught at the Wharton School and Princeton Universityand has been a visiting researcher at INRA in Montpellier and a visiting professor at Paris V. De Veaux has won numerous teaching awards from the Engineering Council at Princeton. He has won both the Wilcoxon and Shewell (twice) awards from the ASQ is a fellow of the ASA and an elected member of the ISI. In 2006-2007 he was the William R. Kenan Jr. Visiting Professor for Distinguished Teaching at Princeton. In 2008 he was named the Statistician of the Year by the Boston Chapter of the ASA. He has served on the Board of Directors of the ASA and is past chair of the Section on Statistical Learning and Data Science and is the 2019-2021 Vice President. Dick has been a consultant for over 30 years for such Fortune 500 companies as Hewlett-Packard, Alcoa, American Express, Bank One,GlaxoSmithKline.

Relevance to Conference Goals

Directly relevant to themes of practical issues in big data.

We begin with a graphical approach to bootstrapping and permutation testing, illuminating basic statistical concepts of standard errors, confidence intervals, p-values and significance tests.

We consider a variety of statistics (mean, trimmed mean, regression, etc.), and a number of sampling situations (one-sample, two-sample, stratified, finite-population), stressing the common techniques that apply in these situations. We'll look at applications from a variety of fields, including telecommunications, finance, and biopharm.

These methods let us do confidence intervals and hypothesis tests when formulas are not available. This lets us do better statistics, e.g. use robust methods (we can use a median or trimmed mean instead of a mean, for example). They can help clients understand statistical variability. And some of the methods are more accurate than standard methods.

Outline & Objectives

Introduction to Bootstrapping
General procedure
Why does bootstrapping work?
Sampling distribution and bootstrap distribution

Bootstrap Distributions and Standard Errors
Distribution of the sample mean
Bootstrap distributions of other statistics
Simple confidence intervals
Two-sample applications

How Accurate Is a Bootstrap Distribution?

Bootstrap Confidence Intervals
Bootstrap percentiles as a check for standard intervals
More accurate bootstrap confidence intervals

Significance Testing Using Permutation Tests
Two-sample applications
Other settings

Wider variety of statistics
Variety of applications
Examples where things go wrong, and what to look for

Wider variety of sampling methods
Stratified sampling, hierarchical sampling
Finite population
Regression
Time series

Participants will learn how to use resampling methods:
* to compute standard errors,
* to check the accuracy of the usual Gaussian-based methods,
* to compute both quick and more accurate confidence intervals,
* for a variety of statistics and
* for a variety of sampling methods, and
* to perform significance tests in some settings.

About the Instructor

Dr. Tim Hesterberg is a Senior Data Scientist at Google. He previously worked at Insightful (S-PLUS), Franklin & Marshall College, and Pacific Gas & Electric Co. He received his Ph.D. in Statistics from Stanford University, under Brad Efron.

Hesterberg is author of the "Resample" package for R and primary author of the "S+Resample" package for bootstrapping, permutation tests, jackknife, and other resampling procedures, is co-author of Chihara and Hesterberg "Mathematical Statistics with Resampling and R" (2011), and is lead author of "Bootstrap Methods and Permutation Tests" (2010), W. H. Freeman, ISBN 0-7167-5726-5, and technical articles on resampling. See http://www.timhesterberg.net/bootstrap.

Hesterberg is on the executive boards of the National Institute of Statistical Sciences and the Interface Foundation of North America (Interface between Computing Science and Statistics).

He teaches kids to make water bottle rockets, leads groups of high school students to set up computer labs abroad, and actively fights climate chaos.

Relevance to Conference Goals

Resampling methods are important in statistical practice, but are omitted or poorly covered in many old-style statistics courses. These methods are an important part of the toolbox of any practicing statistician.

It is important when using these methods to have some understanding of the ideas behind these methods, to understand when they should or should not be used.

They are not a panacea. People tend to think of bootstrapping in small samples, when they don't trust the central limit theorem. However, the common combinations of nonparametric bootstrap and percentile intervals is actually accurate than t procedures. We discuss why, remedies, and better procedures that are only slightly more complicated.

These tools also show how poor common rules of thumb are -- in particular, n >= 30 is woefully inadequate for judging whether t procedures should be OK.

Communicating Data Clearly describes how to draw clear, concise, accurate graphs that are easier to understand than many of the graphs one sees today. The course emphasizes how to avoid common mistakes that produce confusing or even misleading graphs. Graphs for one, two, three, and many variables are covered as well as general principles for creating effective graphs.

Outline & Objectives

This course begins by reviewing human perception and our ability to decode graphical information. It continues by:

• Ranking elementary graphical perception tasks to identify those that we do the best.

• Showing the limitations of many common graphical constructions.

• Demonstrating newer, more effective graphical forms developed on the basis of the ranking.

• Providing general principles for creating effective graphs.

• Commenting on software packages that produce graphs.

• Comparing the same data using different graph forms so the audience can see how understanding depends on the graphical construction used.

• Discussing Trellis Display (a framework for the visualization of multivariate data) and other innovative methods for presenting more than two variables.

• Presenting some graphical methods for categorical data.

Since scales (the rulers along which we graph the data) have a profound effect on our interpretation of graphs, the section on general principles contains a detailed discussion of scales.

The course concludes with before and after examples that reinforce the topics covered.

About the Instructor

Naomi B. Robbins is a consultant and seminar leader who specializes in the graphical display of data. She offers keynotes, short courses and workshops to train employees of corporations and organizations on the effective presentation of data. She also reviews documents and presentations for clients, suggesting improvements or alternative presentations as appropriate. She is the author of Creating More Effective Graphs, published by Chart House (2013). Dr. Robbins has been the keynote speaker at international conventions and has spoken on graphs to universities, professional societies, corporations, and non-profits. She received her Ph.D. in mathematical statistics from Columbia University, M.A. from Cornell University, and A.B. from Bryn Mawr College. She had a long career at Bell Laboratories before forming NBR, her consulting practice. Naomi was chair of the Statistical Graphics Section of the American Statistical Association and is the organizer of the Data Visualization New York Meetup.

Relevance to Conference Goals

Attendees will be exposed to graphical techniques, some of which may be new to them. Ideas covered are immediately applicable.

The entire emphasis of the course is to use best graphical practices to communicate quantitative information better.

Effective charts and graphs and understanding data better lead to better decisions which have a positive impact on the company. Communicating data better saves time at meetings.

Better communication of data enhances one’s career and avoids the loss of credibility that comes with using confusing, misleading or deceptive figures.

This half day workshop discusses growth models from the multilevel and structural equation modeling perspectives. Growth models have become a mainstay of longitudinal data analysis in the social and behavioral sciences to examine how individuals change over time and how individuals differ in their change process. The workshop covers several introductory topics that range from linear and nonlinear growth models to the inclusion of time-invariant and time-varying covariates. For analysis, we will discuss and use the structural equation modeling and multilevel modeling frameworks available through R and Mplus. The training is intended for faculty, postdocs and advanced graduate students who are familiar with structural equation modeling and multilevel modeling.

Outline & Objectives

The objectives of this full day workshop are to (1) understand the uniqueness of longitudinal data and the challenges of modeling individual change over time, (2) estimate linear and nonlinear growth models using R and Mplus, (3) interpret model parameters and their importance, and (4) estimate models with time-invariant and time-varying covariates while distinguishing between within- and between-person effects.

About the Instructor

Kevin J. Grimm, Ph.D., is a Professor in the Department of Psychology at Arizona State University, where he teaches classes on the analysis of variance, longitudinal growth modeling, machine learning, and structural equation modeling. He received his B.A. in Mathematics and Psychology with a concentration in Education from Gettysburg College in 2000, his M.A. and Ph.D. in Psychology from the University of Virginia (2001-2006). His research interests include longitudinal methodology, exploratory data analysis, and data integration, especially the integration of longitudinal studies. His recent research has focused on nonlinearity in growth models, growth mixture models, extensions of latent change score models, and approaches for analyzing change with limited dependent variables. Dr. Grimm directs the American Psychological Association’s Advanced Training Institutes on Structural Equation Modeling in Longitudinal Research and Big Data: Exploratory Data Mining.

Relevance to Conference Goals

This workshop is in line with the goals of the conference for Data Modeling and Analysis and well as Communication. This workshop will engage the audience to consider the various possibilities of modeling longitudinal data, and be able to communicate their findings to wider audiences.

Decisions on projects are often not made only from algorithms or based on the recommendation of statisticians. The importance of well-balanced technical and non-technical skills is essential for a statistician to be successful in collaborating and leading multi-disciplinary projects. With a well-balanced skill set, statisticians have the opportunity to use their analytical abilities to the fullest extent. However, to maximize the use of these skills, this requires statisticians to move outside of their comfort zone in order to excel in the leadership of cross-functional teams, to demonstrate strong communication and collaboration skills and to manage the conflicts that may occur when facing challenges outside of the realm of statistics.

Outline & Objectives

This short course will focus on providing statisticians with the guidance on the non-technical skills that they need to develop expertise to be successful in quantitative decision making when working with non-statisticians. The first half of the course will focus on providing guidance on the best practices for statisticians to be successful with their oral and written communication through case studies of real world scenarios from work as a statistician operating in cross-functional teams. The scope of these topics will include coverage of: active listening, asking the right questions, using the right vocal tones for the situation, networking, emotional intelligence, self-awareness of the surround environment, and receiving and providing further feedback. References to further reading and online material will be given. The second half of the short-course will focus on how statisticians can make best use of their analytical skills and become successful cross-functional leaders. Time will also be spent on understanding how to best handle conflicts and how to use analytical skills to win the right battles that statisticians face on a daily basis.

About the Instructor

The two speakers have more than 40 years of experience combined as statisticians in the pharmaceuticals industry. Dr. Mesenbrink has been an active spokesperson for the Leadership Initiative within the American Statistical Association while Dr. Guettner is leading an initiative within Novartis on leadership and soft skill development for statisticians. In addition to external publications and presentations on the subject matter, Dr. Mesenbrink is currently finishing the writing of the book: How to be a Successful Biostatistician in Industry for CRC Press which is projected to be published by the end of 2018.

Relevance to Conference Goals

As a meeting that is intended to help statisticians obtain practical needed for them to grow in their careers, this short course is aligned with the conference goals to provide statistician with practical knowledge needed to help them to continue grow and expand their potential career paths.