Computational Tools to Support Large-Scale CyberShake PSHA Simulations
Date: 4/24/2019
Time: 05:15 PM
Room: Elliott Bay
The Southern California Earthquake Center (SCEC) has developed CyberShake, a software platform to perform physics-based probabilistic seismic hazard analysis (PSHA) using 3D deterministic wave propagation simulations. The CyberShake computational method requires the simulation of a volume of Strain Green Tensors using AWP-ODC-SGT, a parallel GPU code, and hundreds of thousands of serial CPU seismic reciprocity calculations to synthesize seismograms for all relevant events for a single site of interest.
Since a typical CyberShake hazard model includes PSHA results for hundreds of locations, performing a CyberShake regional study typically requires hundreds of terabytes of storage and tens of millions of core-hours on large systems. These studies are supported by a scientific workflow software stack, including Pegasus-WMS, HTCondor, and the Globus Toolkit, which enables automated remote job submission, data management, and fault tolerance.
Recently, SCEC conducted CyberShake Study 18.8, producing a physics-based PSHA hazard model for a large Northern California region that includes the San Francisco Bay Area. PSHA calculations up to 1 Hz for 869 locations in Central and Northern California were performed using the NCSA Blue Waters, OLCF Titan, and USC HPC supercomputers. We will present our software framework and workflow infrastructure which supported CyberShake Study 18.8. We will discuss features required for concurrent execution on multiple distributed systems, including dynamic assignment of workflows to systems, site-specific approaches for remote job submission, and monitoring tools. We will show how this integrated platform enables high throughput and supports the calculation of large-scale physics-based PSHA models in a reasonable makespan.
Presenting Author: Scott Callaghan
Authors
Scott Callaghan scottcal@usc.edu University of Southern California, Los Angeles, California, United States Presenting Author
Corresponding Author
|
Philip J Maechling maechlin@usc.edu University of Southern California, Los Angeles, California, United States |
Christine A Goulet cgoulet@usc.edu University of Southern California, Los Angeles, California, United States |
Kevin R Milner kmilner@usc.edu University of Southern California, Los Angeles, California, United States |
Mei-Hui Su mei@uscedu.onmicrosoft.com University of Southern California, Los Angeles, California, United States |
Karan Vahi vahi@isi.edu USC Information Sciences Institute, Marina del Rey, California, United States |
Ewa Deelman deelman@isi.edu USC Information Sciences Institute, Marina del Rey, California, United States |
Robert W Graves rwgraves@usgs.gov U.S. Geological Survey, Pasadena, California, United States |
Kim B Olsen kbolsen@sdsu.edu San Diego State University, San Diego, California, United States |
Yifeng Cui yfcui@sdsc.edu San Diego State University, San Diego, California, United States |
Thomas H Jordan tjordan@usc.edu University of Southern California, Los Angeles, California, United States |
Computational Tools to Support Large-Scale CyberShake PSHA Simulations
Category
Science Gateways and Computational Tools for Improving Earthquake Research