Evolution and Optimization of the Raspberry Shake Data Center: Managing the World's Largest Real-time Seismic Network
Description:
The Raspberry Shake Data Center (SDC) has undergone a comprehensive redesign in 2024 to meet the demands of both a large network and its ongoing rapid growth. Currently managing 2,500 online stations, ~7,000 channels, each streaming at 100 samples per second, the SDC supports all aspects of what it means to host and manage the world's largest real-time seismic network. The new infrastructure has been architected with an eye towards gracefully handling the network's future expansion, anticipated to exceed 10,000 stations.
We present the technical infrastructure and architectural solutions implemented to handle massive-scale data acquisition and distribution. Given the scaling requirements for a seismic data network intended to be up and available 24/7/365, open-source technologies in the seismological communities alone are not able to deliver a solution satisfying the network's myriad requirements. This led to the development of custom C/C++ solutions optimized for high-throughput data handling, automatic fail-over and recovery of critical systems, the ability to easily scale the server-side infrastructure both vertically and horizontally, and more. The integration of gempa GmbH's CAPS software has been crucial in enabling efficient data distribution at large scales.
This presentation details the implementation of multi-level redundancy systems and discusses how a citizen science initiative evolved to require enterprise-level data center capabilities. We focus on the technical challenges of scaling real-time seismic data acquisition and distribution beyond conventional boundaries, highlighting solutions for managing high-volume data streams, all the while maintaining system accessibility, reliability, and integrity.
Keywords: seismic networks, real-time data acquisition, data distribution, network scaling, data center infrastructure, raspberry shake
Session: Network Seismology: Recent Developments, Challenges and Lessons Learned - I
Type: Oral
Date: 4/15/2025
Presentation Time: 08:00 AM (local time)
Presenting Author: Branden
Student Presenter: No
Invited Presentation:
Poster Number:
Authors
Branden Christensen Presenting Author Corresponding Author branden.christensen@raspberryshake.org Raspberry Shake, S.A. |
Richard Boaz richard@raspberryshake.org Raspberry Shake, S.A. |
|
|
|
|
|
|
|
Evolution and Optimization of the Raspberry Shake Data Center: Managing the World's Largest Real-time Seismic Network
Category
Network Seismology: Recent Developments, Challenges and Lessons Learned