The University of Southampton
×
Filter your search:
University of Southampton Institutional Repository

DES science portal: Creating science-ready catalogs

DES science portal: Creating science-ready catalogs
DES science portal: Creating science-ready catalogs

We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

Astronomical databases, Catalogs, Data analysis, Surveys—methods
2213-1337
52-69
Fausti Neto, A.
fdac2535-62a7-4288-9a6e-49d12e01b6cb
da Costa, L. N.
b1ed9fd9-b99a-4012-8112-79cba46d8a23
Carnero, A.
535b5bbc-bde5-42b1-85b0-47d4714580d6
Gschwend, J.
cfbbfd77-feea-4e19-91b7-f40b8969f453
Ogando, R. L.C.
2af3ab81-7deb-456f-bce7-67ade23683d3
Sobreira, F.
eef47e5c-d638-4eed-86b6-6ce312da75d5
Maia, M. A.G.
98ea0959-ba94-454f-b826-a589acf2297c
Santiago, B. X.
50c49d16-76aa-4648-8631-052d01fd2767
Rosenfeld, R.
932244a8-2a6f-4ff8-8a97-a6ee2d1d4669
Singulani, C.
e69425d2-e429-48f8-9ed0-20b5e85c8d55
Adean, C.
f084a0dd-e7fd-4168-8128-a3c5d711f927
Nunes, L. D.P.
d03784cf-0068-439e-ae70-199c67b70561
Campisano, R.
42e19dd6-3263-4ca8-961c-667da18ed79b
Brito, R.
629a6576-acd5-490a-a9c2-4c406e7e850e
Soares, G.
65b2a651-4d97-4bca-9b88-340b2793e31c
Vila-Verde, G. C.
84daa976-0bb8-4bca-affa-00014795fa18
Abbott, T. M.C.
6afa6308-fd36-4189-aef0-d86c784311d9
Abdalla, F. B.
b32ec665-df5e-4703-9eef-a9b15ea7cf08
Allam, S.
0355ab50-73f1-493b-80dc-86c4d4422bee
Benoit-Lévy, A.
eea5849b-ea03-4147-8c3b-61255cbb30eb
Brooks, D.
a3c528d9-fb8a-406c-bc92-56eff4985bcf
Buckley-Geer, E.
ad57a7c9-6dbf-4b3d-a69f-d6cc5bb4fb8a
Capozzi, D.
3a3a565f-bc35-4027-8432-7a1a34344cce
Carrasco Kind, M.
b569a608-55e3-4a2b-8875-d6602c32c980
Carretero, J.
081b0f5d-7e69-469c-a22d-5b851f9b8d1d
D'Andrea, C. B.
4befc380-f47c-49cc-a84e-2e2d2ac14edd
Desai, S.
9fb3d948-7af8-43e1-8c9c-a11b6cc376ce
Doel, P.
00d69910-6075-4a52-9c7b-57e947a3b171
Drlica-Wagner, A.
d47129ae-3b89-4fca-bab4-8b4019b1da05
Evrard, A. E.
b72fc85a-1ab1-4c95-afad-e1ff76f8190c
Fosalba, P.
7309d371-b57b-4fb5-99f2-1dd419e46285
García-Bellido, J.
0d901d62-f268-4982-a08b-880c578ab3d8
Gerdes, D. W.
63df801a-6703-4911-902c-1115327d79dd
Gruendl, R. A.
81783218-3c05-4a4a-8f7b-d123d50ba027
Gutierrez, G.
78403287-6c1e-4238-9238-06c3a714f5cd
Honscheid, K.
c505a24c-7e4d-4761-a84d-5262868372ae
James, D. J.
2c41d97c-8486-4379-b253-e5896572e81a
Jeltema, T. E.
c7ceea0d-1f0c-42e2-883d-d83e976ab6ec
Kuehn, K.
c8275e43-4cd6-44f5-9cce-8475d0e5f7de
Kuhlmann, S.
e3c8cf69-3749-45fc-89cf-8a6499ac12ba
Kuropatkin, N.
328b5b5c-833e-4299-9914-578624826327
Lahav, O.
2e4e31a0-1b02-4b64-9d7d-fc7f81f56be8
Lima, M.
01e865ee-c676-4f04-9b0a-aaeb3b4138fa
Marshall, J. L.
a80432e4-3031-4224-b1cf-313bc1bda078
Melchior, P.
a10454a8-5f20-4eda-a63e-289fde692fc6
Menanteau, F.
d971ef80-9290-4fb1-87bf-d9b5e1e80821
Plazas, A.
aafd9982-a941-421d-a7fe-0c989d230dbd
Sanchez, E.
cf73c967-6a9b-4a5e-8e99-26198ecc3d6c
Scarpine, V.
dc6fe7f7-d923-434b-81d7-fa48ff16b705
Schindler, R.
9bd3fa15-7763-445e-a877-9de8f69ac054
Schubnell, M.
076bbd0d-6b89-4186-9b9b-94e01ca43cdb
Sevilla-Noarbe, I.
a4690b61-feca-4933-887c-121a9f343470
Smith, M.
8bdc74e1-a37b-434d-ae75-82763109bf7a
Smith, R. C.
2890e5a7-d3ae-4850-924a-be58b7a15a73
Suchyta, E.
632e180b-6712-4435-b31e-7706c0ed1b05
Swanson, M. E.C.
5f7dc788-a30e-4a8e-b925-67fbb97015f5
Tarle, G.
d5a81816-3f96-42c2-88ef-f86969bedc6e
Walker, A. R.
83fb59b8-4447-462f-874e-90d5e9a46787
Fausti Neto, A.
fdac2535-62a7-4288-9a6e-49d12e01b6cb
da Costa, L. N.
b1ed9fd9-b99a-4012-8112-79cba46d8a23
Carnero, A.
535b5bbc-bde5-42b1-85b0-47d4714580d6
Gschwend, J.
cfbbfd77-feea-4e19-91b7-f40b8969f453
Ogando, R. L.C.
2af3ab81-7deb-456f-bce7-67ade23683d3
Sobreira, F.
eef47e5c-d638-4eed-86b6-6ce312da75d5
Maia, M. A.G.
98ea0959-ba94-454f-b826-a589acf2297c
Santiago, B. X.
50c49d16-76aa-4648-8631-052d01fd2767
Rosenfeld, R.
932244a8-2a6f-4ff8-8a97-a6ee2d1d4669
Singulani, C.
e69425d2-e429-48f8-9ed0-20b5e85c8d55
Adean, C.
f084a0dd-e7fd-4168-8128-a3c5d711f927
Nunes, L. D.P.
d03784cf-0068-439e-ae70-199c67b70561
Campisano, R.
42e19dd6-3263-4ca8-961c-667da18ed79b
Brito, R.
629a6576-acd5-490a-a9c2-4c406e7e850e
Soares, G.
65b2a651-4d97-4bca-9b88-340b2793e31c
Vila-Verde, G. C.
84daa976-0bb8-4bca-affa-00014795fa18
Abbott, T. M.C.
6afa6308-fd36-4189-aef0-d86c784311d9
Abdalla, F. B.
b32ec665-df5e-4703-9eef-a9b15ea7cf08
Allam, S.
0355ab50-73f1-493b-80dc-86c4d4422bee
Benoit-Lévy, A.
eea5849b-ea03-4147-8c3b-61255cbb30eb
Brooks, D.
a3c528d9-fb8a-406c-bc92-56eff4985bcf
Buckley-Geer, E.
ad57a7c9-6dbf-4b3d-a69f-d6cc5bb4fb8a
Capozzi, D.
3a3a565f-bc35-4027-8432-7a1a34344cce
Carrasco Kind, M.
b569a608-55e3-4a2b-8875-d6602c32c980
Carretero, J.
081b0f5d-7e69-469c-a22d-5b851f9b8d1d
D'Andrea, C. B.
4befc380-f47c-49cc-a84e-2e2d2ac14edd
Desai, S.
9fb3d948-7af8-43e1-8c9c-a11b6cc376ce
Doel, P.
00d69910-6075-4a52-9c7b-57e947a3b171
Drlica-Wagner, A.
d47129ae-3b89-4fca-bab4-8b4019b1da05
Evrard, A. E.
b72fc85a-1ab1-4c95-afad-e1ff76f8190c
Fosalba, P.
7309d371-b57b-4fb5-99f2-1dd419e46285
García-Bellido, J.
0d901d62-f268-4982-a08b-880c578ab3d8
Gerdes, D. W.
63df801a-6703-4911-902c-1115327d79dd
Gruendl, R. A.
81783218-3c05-4a4a-8f7b-d123d50ba027
Gutierrez, G.
78403287-6c1e-4238-9238-06c3a714f5cd
Honscheid, K.
c505a24c-7e4d-4761-a84d-5262868372ae
James, D. J.
2c41d97c-8486-4379-b253-e5896572e81a
Jeltema, T. E.
c7ceea0d-1f0c-42e2-883d-d83e976ab6ec
Kuehn, K.
c8275e43-4cd6-44f5-9cce-8475d0e5f7de
Kuhlmann, S.
e3c8cf69-3749-45fc-89cf-8a6499ac12ba
Kuropatkin, N.
328b5b5c-833e-4299-9914-578624826327
Lahav, O.
2e4e31a0-1b02-4b64-9d7d-fc7f81f56be8
Lima, M.
01e865ee-c676-4f04-9b0a-aaeb3b4138fa
Marshall, J. L.
a80432e4-3031-4224-b1cf-313bc1bda078
Melchior, P.
a10454a8-5f20-4eda-a63e-289fde692fc6
Menanteau, F.
d971ef80-9290-4fb1-87bf-d9b5e1e80821
Plazas, A.
aafd9982-a941-421d-a7fe-0c989d230dbd
Sanchez, E.
cf73c967-6a9b-4a5e-8e99-26198ecc3d6c
Scarpine, V.
dc6fe7f7-d923-434b-81d7-fa48ff16b705
Schindler, R.
9bd3fa15-7763-445e-a877-9de8f69ac054
Schubnell, M.
076bbd0d-6b89-4186-9b9b-94e01ca43cdb
Sevilla-Noarbe, I.
a4690b61-feca-4933-887c-121a9f343470
Smith, M.
8bdc74e1-a37b-434d-ae75-82763109bf7a
Smith, R. C.
2890e5a7-d3ae-4850-924a-be58b7a15a73
Suchyta, E.
632e180b-6712-4435-b31e-7706c0ed1b05
Swanson, M. E.C.
5f7dc788-a30e-4a8e-b925-67fbb97015f5
Tarle, G.
d5a81816-3f96-42c2-88ef-f86969bedc6e
Walker, A. R.
83fb59b8-4447-462f-874e-90d5e9a46787

Fausti Neto, A., da Costa, L. N., Carnero, A., Gschwend, J., Ogando, R. L.C., Sobreira, F., Maia, M. A.G., Santiago, B. X., Rosenfeld, R., Singulani, C., Adean, C., Nunes, L. D.P., Campisano, R., Brito, R., Soares, G., Vila-Verde, G. C., Abbott, T. M.C., Abdalla, F. B., Allam, S., Benoit-Lévy, A., Brooks, D., Buckley-Geer, E., Capozzi, D., Carrasco Kind, M., Carretero, J., D'Andrea, C. B., Desai, S., Doel, P., Drlica-Wagner, A., Evrard, A. E., Fosalba, P., García-Bellido, J., Gerdes, D. W., Gruendl, R. A., Gutierrez, G., Honscheid, K., James, D. J., Jeltema, T. E., Kuehn, K., Kuhlmann, S., Kuropatkin, N., Lahav, O., Lima, M., Marshall, J. L., Melchior, P., Menanteau, F., Plazas, A., Sanchez, E., Scarpine, V., Schindler, R., Schubnell, M., Sevilla-Noarbe, I., Smith, M., Smith, R. C., Suchyta, E., Swanson, M. E.C., Tarle, G. and Walker, A. R. (2018) DES science portal: Creating science-ready catalogs. Astronomy and Computing, 24, 52-69. (doi:10.1016/j.ascom.2018.01.002).

Record type: Article

Abstract

We present a novel approach for creating science-ready catalogs through a software infrastructure developed for the Dark Energy Survey (DES). We integrate the data products released by the DES Data Management and additional products created by the DES collaboration in an environment known as DES Science Portal. Each step involved in the creation of a science-ready catalog is recorded in a relational database and can be recovered at any time. We describe how the DES Science Portal automates the creation and characterization of lightweight catalogs for DES Year 1 Annual Release, and show its flexibility in creating multiple catalogs with different inputs and configurations. Finally, we discuss the advantages of this infrastructure for large surveys such as DES and the Large Synoptic Survey Telescope. The capability of creating science-ready catalogs efficiently and with full control of the inputs and configurations used is an important asset for supporting science analysis using data from large astronomical surveys.

This record has no associated files available for download.

More information

Accepted/In Press date: 16 January 2018
e-pub ahead of print date: 15 May 2018
Published date: 1 July 2018
Keywords: Astronomical databases, Catalogs, Data analysis, Surveys—methods

Identifiers

Local EPrints ID: 424954
URI: http://eprints.soton.ac.uk/id/eprint/424954
DOI: doi:10.1016/j.ascom.2018.01.002
ISSN: 2213-1337
PURE UUID: 9fb97080-3fbf-4c09-9ff3-b4b97976b1a8
ORCID for M. Smith: ORCID iD orcid.org/0000-0002-3321-1432

Catalogue record

Date deposited: 05 Oct 2018 16:30
Last modified: 12 Nov 2024 02:50

Export record

Altmetrics

Contributors

Author: A. Fausti Neto
Author: L. N. da Costa
Author: A. Carnero
Author: J. Gschwend
Author: R. L.C. Ogando
Author: F. Sobreira
Author: M. A.G. Maia
Author: B. X. Santiago
Author: R. Rosenfeld
Author: C. Singulani
Author: C. Adean
Author: L. D.P. Nunes
Author: R. Campisano
Author: R. Brito
Author: G. Soares
Author: G. C. Vila-Verde
Author: T. M.C. Abbott
Author: F. B. Abdalla
Author: S. Allam
Author: A. Benoit-Lévy
Author: D. Brooks
Author: E. Buckley-Geer
Author: D. Capozzi
Author: M. Carrasco Kind
Author: J. Carretero
Author: C. B. D'Andrea
Author: S. Desai
Author: P. Doel
Author: A. Drlica-Wagner
Author: A. E. Evrard
Author: P. Fosalba
Author: J. García-Bellido
Author: D. W. Gerdes
Author: R. A. Gruendl
Author: G. Gutierrez
Author: K. Honscheid
Author: D. J. James
Author: T. E. Jeltema
Author: K. Kuehn
Author: S. Kuhlmann
Author: N. Kuropatkin
Author: O. Lahav
Author: M. Lima
Author: J. L. Marshall
Author: P. Melchior
Author: F. Menanteau
Author: A. Plazas
Author: E. Sanchez
Author: V. Scarpine
Author: R. Schindler
Author: M. Schubnell
Author: I. Sevilla-Noarbe
Author: M. Smith ORCID iD
Author: R. C. Smith
Author: E. Suchyta
Author: M. E.C. Swanson
Author: G. Tarle
Author: A. R. Walker

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Library staff additional information
Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×