A bilevel formalism for the peer-reviewing problem
A bilevel formalism for the peer-reviewing problem
Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a bilevel programming (BP) formulation. Our model consists of a lower-level problem describing the reviewers' perspective and an upper-level problem describing the editors'. Every reviewer is interested in minimizing their overall effort, while the editors are interested in finding an allocation that maximizes the quality of the reviews and follows the reviewers' preferences the most. To the best of our knowledge, the proposed model is the first one that formulates the peer-reviewing matching problem by considering two objective functions, one to describe the reviewers' viewpoint and the other to describe the editors' viewpoint. We demonstrate that both the upper-level and lower-level problems are feasible and that our BP model admits a solution under mild assumptions. After studying the properties of the solutions, we propose a heuristic to solve our model and compare its performance with the relevant state-of-the-art methods. Extensive numerical results show that our approach can find fairer solutions with competitive quality and less effort from the reviewers.(Our code website: https://github.com/Galaxy-ZRX/Bilevel-Review.)
133-140
Auricchio, Gennaro
79ad0caf-ccf9-4c58-b051-2c43d6dc67a1
Zhang, Ruixiao
fc3c4eb9-b692-4ab3-8056-030cb6731fc5
Zhang, Jie
6bad4e75-40e0-4ea3-866d-58c8018b225a
Cai, Xiaohao
de483445-45e9-4b21-a4e8-b0427fc72cee
28 September 2023
Auricchio, Gennaro
79ad0caf-ccf9-4c58-b051-2c43d6dc67a1
Zhang, Ruixiao
fc3c4eb9-b692-4ab3-8056-030cb6731fc5
Zhang, Jie
6bad4e75-40e0-4ea3-866d-58c8018b225a
Cai, Xiaohao
de483445-45e9-4b21-a4e8-b0427fc72cee
Auricchio, Gennaro, Zhang, Ruixiao, Zhang, Jie and Cai, Xiaohao
(2023)
A bilevel formalism for the peer-reviewing problem.
Gal, Kobi, Gal, Kobi, Nowe, Ann, Nalepa, Grzegorz J., Fairstein, Roy and Radulescu, Roxana
(eds.)
In ECAI 2023 - 26th European Conference on Artificial Intelligence, including 12th Conference on Prestigious Applications of Intelligent Systems, PAIS 2023 - Proceedings.
vol. 372,
IOS Press.
.
(doi:10.3233/FAIA230263).
Record type:
Conference or Workshop Item
(Paper)
Abstract
Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a bilevel programming (BP) formulation. Our model consists of a lower-level problem describing the reviewers' perspective and an upper-level problem describing the editors'. Every reviewer is interested in minimizing their overall effort, while the editors are interested in finding an allocation that maximizes the quality of the reviews and follows the reviewers' preferences the most. To the best of our knowledge, the proposed model is the first one that formulates the peer-reviewing matching problem by considering two objective functions, one to describe the reviewers' viewpoint and the other to describe the editors' viewpoint. We demonstrate that both the upper-level and lower-level problems are feasible and that our BP model admits a solution under mild assumptions. After studying the properties of the solutions, we propose a heuristic to solve our model and compare its performance with the relevant state-of-the-art methods. Extensive numerical results show that our approach can find fairer solutions with competitive quality and less effort from the reviewers.(Our code website: https://github.com/Galaxy-ZRX/Bilevel-Review.)
Text
FAIA-372-FAIA230263
- Version of Record
More information
Published date: 28 September 2023
Additional Information:
Funding Information:
This project is partially supported by a Leverhulme Trust Research Project Grant (2021–2024). Jie Zhang is also supported by the EP-SRC grant (EP/W014912/1).
Venue - Dates:
26th European Conference on Artificial Intelligence, ECAI 2023, , Krakow, Poland, 2023-09-30 - 2023-10-04
Identifiers
Local EPrints ID: 486144
URI: http://eprints.soton.ac.uk/id/eprint/486144
ISSN: 0922-6389
PURE UUID: 292cd44e-ab04-4766-9c94-20523139e159
Catalogue record
Date deposited: 10 Jan 2024 17:50
Last modified: 18 Mar 2024 03:56
Export record
Altmetrics
Contributors
Author:
Gennaro Auricchio
Author:
Ruixiao Zhang
Author:
Jie Zhang
Author:
Xiaohao Cai
Editor:
Kobi Gal
Editor:
Kobi Gal
Editor:
Ann Nowe
Editor:
Grzegorz J. Nalepa
Editor:
Roy Fairstein
Editor:
Roxana Radulescu
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics