The University of Southampton
University of Southampton Institutional Repository

A bilevel formalism for the peer-reviewing problem

A bilevel formalism for the peer-reviewing problem
A bilevel formalism for the peer-reviewing problem

Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a bilevel programming (BP) formulation. Our model consists of a lower-level problem describing the reviewers' perspective and an upper-level problem describing the editors'. Every reviewer is interested in minimizing their overall effort, while the editors are interested in finding an allocation that maximizes the quality of the reviews and follows the reviewers' preferences the most. To the best of our knowledge, the proposed model is the first one that formulates the peer-reviewing matching problem by considering two objective functions, one to describe the reviewers' viewpoint and the other to describe the editors' viewpoint. We demonstrate that both the upper-level and lower-level problems are feasible and that our BP model admits a solution under mild assumptions. After studying the properties of the solutions, we propose a heuristic to solve our model and compare its performance with the relevant state-of-the-art methods. Extensive numerical results show that our approach can find fairer solutions with competitive quality and less effort from the reviewers.(Our code website: https://github.com/Galaxy-ZRX/Bilevel-Review.)

0922-6389
133-140
IOS Press
Auricchio, Gennaro
79ad0caf-ccf9-4c58-b051-2c43d6dc67a1
Zhang, Ruixiao
fc3c4eb9-b692-4ab3-8056-030cb6731fc5
Zhang, Jie
6bad4e75-40e0-4ea3-866d-58c8018b225a
Cai, Xiaohao
de483445-45e9-4b21-a4e8-b0427fc72cee
Gal, Kobi
Gal, Kobi
Nowe, Ann
Nalepa, Grzegorz J.
Fairstein, Roy
Radulescu, Roxana
Auricchio, Gennaro
79ad0caf-ccf9-4c58-b051-2c43d6dc67a1
Zhang, Ruixiao
fc3c4eb9-b692-4ab3-8056-030cb6731fc5
Zhang, Jie
6bad4e75-40e0-4ea3-866d-58c8018b225a
Cai, Xiaohao
de483445-45e9-4b21-a4e8-b0427fc72cee
Gal, Kobi
Gal, Kobi
Nowe, Ann
Nalepa, Grzegorz J.
Fairstein, Roy
Radulescu, Roxana

Auricchio, Gennaro, Zhang, Ruixiao, Zhang, Jie and Cai, Xiaohao (2023) A bilevel formalism for the peer-reviewing problem. Gal, Kobi, Gal, Kobi, Nowe, Ann, Nalepa, Grzegorz J., Fairstein, Roy and Radulescu, Roxana (eds.) In ECAI 2023 - 26th European Conference on Artificial Intelligence, including 12th Conference on Prestigious Applications of Intelligent Systems, PAIS 2023 - Proceedings. vol. 372, IOS Press. pp. 133-140 . (doi:10.3233/FAIA230263).

Record type: Conference or Workshop Item (Paper)

Abstract

Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a bilevel programming (BP) formulation. Our model consists of a lower-level problem describing the reviewers' perspective and an upper-level problem describing the editors'. Every reviewer is interested in minimizing their overall effort, while the editors are interested in finding an allocation that maximizes the quality of the reviews and follows the reviewers' preferences the most. To the best of our knowledge, the proposed model is the first one that formulates the peer-reviewing matching problem by considering two objective functions, one to describe the reviewers' viewpoint and the other to describe the editors' viewpoint. We demonstrate that both the upper-level and lower-level problems are feasible and that our BP model admits a solution under mild assumptions. After studying the properties of the solutions, we propose a heuristic to solve our model and compare its performance with the relevant state-of-the-art methods. Extensive numerical results show that our approach can find fairer solutions with competitive quality and less effort from the reviewers.(Our code website: https://github.com/Galaxy-ZRX/Bilevel-Review.)

Text
FAIA-372-FAIA230263 - Version of Record
Download (338kB)

More information

Published date: 28 September 2023
Additional Information: Funding Information: This project is partially supported by a Leverhulme Trust Research Project Grant (2021–2024). Jie Zhang is also supported by the EP-SRC grant (EP/W014912/1).
Venue - Dates: 26th European Conference on Artificial Intelligence, ECAI 2023, , Krakow, Poland, 2023-09-30 - 2023-10-04

Identifiers

Local EPrints ID: 486144
URI: http://eprints.soton.ac.uk/id/eprint/486144
ISSN: 0922-6389
PURE UUID: 292cd44e-ab04-4766-9c94-20523139e159
ORCID for Xiaohao Cai: ORCID iD orcid.org/0000-0003-0924-2834

Catalogue record

Date deposited: 10 Jan 2024 17:50
Last modified: 18 Mar 2024 03:56

Export record

Altmetrics

Contributors

Author: Gennaro Auricchio
Author: Ruixiao Zhang
Author: Jie Zhang
Author: Xiaohao Cai ORCID iD
Editor: Kobi Gal
Editor: Kobi Gal
Editor: Ann Nowe
Editor: Grzegorz J. Nalepa
Editor: Roy Fairstein
Editor: Roxana Radulescu

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×