The University of Southampton
University of Southampton Institutional Repository
Warning ePrints Soton is experiencing an issue with some file downloads not being available. We are working hard to fix this. Please bear with us.

Data Analysis support in Karabo at European XFEL

Data Analysis support in Karabo at European XFEL
Data Analysis support in Karabo at European XFEL
We describe the data analysis structure that is integrated into the Karabo framework to support scientific experiments and data analysis at European XFEL. The photon science experiments have a range of data analysis requirements, including online (i.e. near real-time during the actual measurement) and offline data analysis. The Karabo data analysis framework supports execution of automatic data analysis for routine tasks, supports complex experiment protocols including data analysis feedback integration to instrument control, and supports integration of external applications. The online data analysis is carried out using distributed and accelerator hardware (such as GPUs) where required to balance load and achieve near real-time data analysis throughput. Analysis routines provided by Karabo are implemented in C++ and Python, and make use of established scientific libraries. The XFEL control and analysis software team collaborates with users to integrate experiment specific analysis codes, protocols and requirements into this framework, and to make it available for the experiments and subsequent offline data analysis.
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
Beg, Marijan
5c7cc1ff-f244-471f-b964-9f24e0628153
Bondar, V.
0c60b4c9-e6ec-476d-8003-323bfc42c426
Aplin, S.
341d16a2-f1c9-401a-9fa1-3f729794e727
Barty, A.
e5861f02-2278-49c7-81ef-7e4a1a66aa72
Kuhn, M.
7f941185-69ba-41ce-9baa-5e749c271f2e
Mariani, V.
cb70bbd0-df41-4445-bfb4-7e6fe5a8f2d7
Kluyver, Thomas
d3bd4245-1a99-4268-b34f-8f9f0153465e
Fangohr, Hans
9b7cfab9-d5dc-45dc-947c-2eba5c81a160
Beg, Marijan
5c7cc1ff-f244-471f-b964-9f24e0628153
Bondar, V.
0c60b4c9-e6ec-476d-8003-323bfc42c426
Aplin, S.
341d16a2-f1c9-401a-9fa1-3f729794e727
Barty, A.
e5861f02-2278-49c7-81ef-7e4a1a66aa72
Kuhn, M.
7f941185-69ba-41ce-9baa-5e749c271f2e
Mariani, V.
cb70bbd0-df41-4445-bfb4-7e6fe5a8f2d7
Kluyver, Thomas
d3bd4245-1a99-4268-b34f-8f9f0153465e

Fangohr, Hans, Beg, Marijan, Bondar, V., Aplin, S., Barty, A., Kuhn, M., Mariani, V. and Kluyver, Thomas (2017) Data Analysis support in Karabo at European XFEL. ICALEPCS 2017: 16th International Conference on Accelerator and Large Experimental Control Systems, , Barcelona, Spain. 08 Oct - 13 Nov 2017.

Record type: Conference or Workshop Item (Paper)

Abstract

We describe the data analysis structure that is integrated into the Karabo framework to support scientific experiments and data analysis at European XFEL. The photon science experiments have a range of data analysis requirements, including online (i.e. near real-time during the actual measurement) and offline data analysis. The Karabo data analysis framework supports execution of automatic data analysis for routine tasks, supports complex experiment protocols including data analysis feedback integration to instrument control, and supports integration of external applications. The online data analysis is carried out using distributed and accelerator hardware (such as GPUs) where required to balance load and achieve near real-time data analysis throughput. Analysis routines provided by Karabo are implemented in C++ and Python, and make use of established scientific libraries. The XFEL control and analysis software team collaborates with users to integrate experiment specific analysis codes, protocols and requirements into this framework, and to make it available for the experiments and subsequent offline data analysis.

Text
Fangohr et al Data analysis support in Karabo at European XFEL - Accepted Manuscript
Download (3MB)
Text
Fangohr etal_Data analysis support in Karabo at European XFEL
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 4 October 2017
Published date: 10 October 2017
Venue - Dates: ICALEPCS 2017: 16th International Conference on Accelerator and Large Experimental Control Systems, , Barcelona, Spain, 2017-10-08 - 2017-11-13

Identifiers

Local EPrints ID: 425097
URI: http://eprints.soton.ac.uk/id/eprint/425097
PURE UUID: 46bd1496-3578-433f-845a-9a00c7acc032
ORCID for Hans Fangohr: ORCID iD orcid.org/0000-0001-5494-7193
ORCID for Marijan Beg: ORCID iD orcid.org/0000-0002-6670-3994
ORCID for Thomas Kluyver: ORCID iD orcid.org/0000-0003-4020-6364

Catalogue record

Date deposited: 10 Oct 2018 16:30
Last modified: 22 Nov 2021 03:06

Export record

Contributors

Author: Hans Fangohr ORCID iD
Author: Marijan Beg ORCID iD
Author: V. Bondar
Author: S. Aplin
Author: A. Barty
Author: M. Kuhn
Author: V. Mariani
Author: Thomas Kluyver ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×