Data Analysis support in Karabo at European XFEL
Data Analysis support in Karabo at European XFEL
We describe the data analysis structure that is integrated into the Karabo framework to support scientific experiments and data analysis at European XFEL. The photon science experiments have a range of data analysis requirements, including online (i.e. near real-time during the actual measurement) and offline data analysis. The Karabo data analysis framework supports execution of automatic data analysis for routine tasks, supports complex experiment protocols including data analysis feedback integration to instrument control, and supports integration of external applications. The online data analysis is carried out using distributed and accelerator hardware (such as GPUs) where required to balance load and achieve near real-time data analysis throughput. Analysis routines provided by Karabo are implemented in C++ and Python, and make use of established scientific libraries. The XFEL control and analysis software team collaborates with users to integrate experiment specific analysis codes, protocols and requirements into this framework, and to make it available for the experiments and subsequent offline data analysis.
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
Beg, Marijan
5c7cc1ff-f244-471f-b964-9f24e0628153
Bondar, V.
0c60b4c9-e6ec-476d-8003-323bfc42c426
Aplin, S.
341d16a2-f1c9-401a-9fa1-3f729794e727
Barty, A.
e5861f02-2278-49c7-81ef-7e4a1a66aa72
Kuhn, M.
7f941185-69ba-41ce-9baa-5e749c271f2e
Mariani, V.
cb70bbd0-df41-4445-bfb4-7e6fe5a8f2d7
Kluyver, Thomas
d3bd4245-1a99-4268-b34f-8f9f0153465e
10 October 2017
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
Beg, Marijan
5c7cc1ff-f244-471f-b964-9f24e0628153
Bondar, V.
0c60b4c9-e6ec-476d-8003-323bfc42c426
Aplin, S.
341d16a2-f1c9-401a-9fa1-3f729794e727
Barty, A.
e5861f02-2278-49c7-81ef-7e4a1a66aa72
Kuhn, M.
7f941185-69ba-41ce-9baa-5e749c271f2e
Mariani, V.
cb70bbd0-df41-4445-bfb4-7e6fe5a8f2d7
Kluyver, Thomas
d3bd4245-1a99-4268-b34f-8f9f0153465e
Fangohr, Hans, Beg, Marijan, Bondar, V., Aplin, S., Barty, A., Kuhn, M., Mariani, V. and Kluyver, Thomas
(2017)
Data Analysis support in Karabo at European XFEL.
ICALEPCS 2017: 16th International Conference on Accelerator and Large Experimental Control Systems, , Barcelona, Spain.
08 Oct - 13 Nov 2017.
Record type:
Conference or Workshop Item
(Paper)
Abstract
We describe the data analysis structure that is integrated into the Karabo framework to support scientific experiments and data analysis at European XFEL. The photon science experiments have a range of data analysis requirements, including online (i.e. near real-time during the actual measurement) and offline data analysis. The Karabo data analysis framework supports execution of automatic data analysis for routine tasks, supports complex experiment protocols including data analysis feedback integration to instrument control, and supports integration of external applications. The online data analysis is carried out using distributed and accelerator hardware (such as GPUs) where required to balance load and achieve near real-time data analysis throughput. Analysis routines provided by Karabo are implemented in C++ and Python, and make use of established scientific libraries. The XFEL control and analysis software team collaborates with users to integrate experiment specific analysis codes, protocols and requirements into this framework, and to make it available for the experiments and subsequent offline data analysis.
Text
Fangohr et al Data analysis support in Karabo at European XFEL
- Accepted Manuscript
Text
Fangohr etal_Data analysis support in Karabo at European XFEL
Restricted to Repository staff only
Request a copy
More information
Accepted/In Press date: 4 October 2017
Published date: 10 October 2017
Venue - Dates:
ICALEPCS 2017: 16th International Conference on Accelerator and Large Experimental Control Systems, , Barcelona, Spain, 2017-10-08 - 2017-11-13
Identifiers
Local EPrints ID: 425097
URI: http://eprints.soton.ac.uk/id/eprint/425097
PURE UUID: 46bd1496-3578-433f-845a-9a00c7acc032
Catalogue record
Date deposited: 10 Oct 2018 16:30
Last modified: 16 Mar 2024 04:18
Export record
Contributors
Author:
Marijan Beg
Author:
V. Bondar
Author:
S. Aplin
Author:
A. Barty
Author:
M. Kuhn
Author:
V. Mariani
Author:
Thomas Kluyver
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics