Big Data Services: Globus Online, Galaxy, GridFTP

• Activity Number: 166
• Type: Topic Contributed
• Date/Time: Monday, August 10, 2015 : 10:30 AM to 12:20 PM
• Sponsor: Section on Statistical Computing
• Author(s): Ravi Madduri*
• Companies: The University of Chicago
• Keywords: big data ; hpc ; cloud ; analysis

Abstract

Big Data analysis has become central to the discovery process in various scientific domains. Challenges however remain in managing, moving, sharing and analyzing large data sets. The use of public cloud services to host sophisticated scientific data and software is transforming scientific practice by enabling broad access to capabilities previously available only to the few. The primary obstacle to more widespread use of public clouds to host scientific software ("cloud-based science gateways") has thus far been the considerable gap between the specialized needs of science applications and the capabilities provided by cloud infrastructures. In this talk, we describe a domain-independent, cloud-based scientific data services platform that combines Globus, Galaxy and Amazon Web Services cloud to manage, transfer, share and analyze big data sets. In addition to describing the capabilities, we will also describe use cases and success stories from life sciences domain