Updates to the U.S. Geological Survey’s Product Distribution Layer and Impacts on Comcat and Realtime Systems
Description:
The U.S. Geological Survey’s (USGS) Product Distribution Layer (PDL; https://ghsc.code-pages.usgs.gov/hazdev/pdl/docs/) is a tool integral to many systems, including, but not limited to, the ANSS Comprehensive Catalog of seismic events (ComCat; https://earthquake.usgs.gov/data/comcat/), Real-time feeds (e.g. https://earthquake.usgs.gov/earthquakes/feed/v1.0/geojson.php), the latest earthquakes map and list (https://earthquake.usgs.gov/earthquakes/map/), and automated data delivery to Advanced National Seismic System (ANSS) contributors. PDL and these affiliated systems are critical for receiving and distributing large amounts of earthquake data in near real-time. In recent years, the Geologic Hazards Science Center’s (GHSC) Hazards Development Team (HazDev) has worked to move PDL systems from on-premises servers into the Cloud. A non-exhaustive list of the benefits of these migrations include scalability, enhanced security, and the ability to implement continuous integration/continuous deployment (CI/CD) and Infrastructure as Code (IaC) for fast system deployment and recovery.
The purpose of this talk is two-fold. First, we will detail the large-scale ComCat database upgrade that occurred following the significant events of the 2023 Kahramanmaraş earthquake sequence, which exposed limitations in the cloud system, and we will discuss the observed effectiveness of Amazon Web Services (AWS) relational database service’s (RDS) scalability before and after the upgrade. Second, we will outline ongoing work to improve PDL’s Java client and systems, and we will discuss the implications for our data consumers and producers.
Session: Leveraging Cutting-Edge Cyberinfrastructure for Large Scale Data Analysis and Education [Poster Session]
Type: Poster
Date: 5/2/2024
Presentation Time: 08:00 AM (local time)
Presenting Author: Heather
Student Presenter: No
Invited Presentation:
Authors
Heather Hunsinger Presenting Author hhunsinger@usgs.gov U.S. Geological Survey |
Eric Martinez emartinez@usgs.gov U.S. Geological Survey |
Jonathan Brown jdbrown@usgs.gov U.S. Geological Survey |
Zachary Cloutet zcloutet@usgs.gov U.S. Geological Survey |
Kirstie Haynie Corresponding Author khaynie@usgs.gov U.S. Geological Survey |
Edward Hunter ehunter@usgs.gov U.S. Geological Survey |
Lynda Lastowka llastowka@usgs.gov U.S. Geological Survey |
|
|
Updates to the U.S. Geological Survey’s Product Distribution Layer and Impacts on Comcat and Realtime Systems
Category
Leveraging Cutting-Edge Cyberinfrastructure for Large Scale Data Analysis and Education