Data reduction activities at European XFEL: early results
Data reduction activities at European XFEL: early results
The European XFEL is a megahertz repetition-rate facility producing extremely bright and coherent pulses of a few tens of femtoseconds duration. The amount of data generated in the context of user experiments can exceed hundreds of gigabits per second, resulting in tens of petabytes stored every year. These rates and volumes pose significant challenges both for facilities and users thereof. In fact, if unaddressed, extraction and interpretation of scientific content will be hindered, and investment and operational costs will quickly become unsustainable. In this article, we outline challenges and solutions in data reduction.
Sobolev, Egor
6ad4f092-a61d-47d9-b70d-11bf237d1258
Schmidt, Philipp
f567aff8-6177-4ae2-9bfe-6e394d90d124
Malka, Janusz
2aaf5f1b-3648-4523-99d9-17c514c5f556
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
27 February 2024
Sobolev, Egor
6ad4f092-a61d-47d9-b70d-11bf237d1258
Schmidt, Philipp
f567aff8-6177-4ae2-9bfe-6e394d90d124
Malka, Janusz
2aaf5f1b-3648-4523-99d9-17c514c5f556
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
Sobolev, Egor, Schmidt, Philipp and Malka, Janusz
,
et al.
(2024)
Data reduction activities at European XFEL: early results.
Frontiers in Physics, 12, [1331329].
(doi:10.3389/fphy.2024.1331329).
Abstract
The European XFEL is a megahertz repetition-rate facility producing extremely bright and coherent pulses of a few tens of femtoseconds duration. The amount of data generated in the context of user experiments can exceed hundreds of gigabits per second, resulting in tens of petabytes stored every year. These rates and volumes pose significant challenges both for facilities and users thereof. In fact, if unaddressed, extraction and interpretation of scientific content will be hindered, and investment and operational costs will quickly become unsustainable. In this article, we outline challenges and solutions in data reduction.
Text
fphy-12-1331329
- Version of Record
More information
Accepted/In Press date: 6 February 2024
Published date: 27 February 2024
Identifiers
Local EPrints ID: 508476
URI: http://eprints.soton.ac.uk/id/eprint/508476
ISSN: 0429-7725
PURE UUID: ce5f8837-c6da-46b0-a0a7-4e7ee9e28f9b
Catalogue record
Date deposited: 23 Jan 2026 17:32
Last modified: 24 Jan 2026 02:39
Export record
Altmetrics
Contributors
Author:
Egor Sobolev
Author:
Philipp Schmidt
Author:
Janusz Malka
Corporate Author: et al.
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
