Sep 9 – 12, 2024
SCC
Europe/Berlin timezone

HPSS S3 Scalability With Rubin LFA S3 Store Use Case

Sep 10, 2024, 11:30 AM
15m
Aula (SCC)

Aula

SCC

Hermann von Helmholtz Platz 1 76344 Eggenstein-Leopoldshafen

Speaker

Ms Guangwei Che

Description

SLAC National Accelerator Laboratory
Technology and Inovation Department
Scientific Computing Systems

With a growing demand on HPSS S3 support from SLAC science user’s community, we eagerly started testing HPSS S3 interface since the pre-GA release in July 2023. From the initial fragile and immature version to today’s more robust and resilient state, we worked directly with HPSS S3 developer’s team to troubleshoot and triage many challenging issues faced with the scalability, data IO performance and the large and deeply nested data structure handling for very small files from Rubin LFA ceph S3 store use case. In this presentation we’ll tell our stories in the journey of bring HPSS S3’s capability to a next level.

Presentation materials

There are no materials yet.