IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v276y2019i2p436-450.html
   My bibliography  Save this article

An alternative polynomial-sized formulation and an optimization based heuristic for the reviewer assignment problem

Author

Listed:
  • Yeşilçimen, Ali
  • Yıldırım, E. Alper

Abstract

Peer review systems are based on evaluating a scholarly work, referred to as a proposal, by experts in that field. In such a system, we consider the reviewer assignment problem, i.e., the problem of assigning proposals to reviewers under the assumption that each reviewer returns her preferences using ordinal rankings. Motivated by the problem defined in Cook et al. (Management Science, 51:655–661, 2005), we focus on reviewer assignments so as to maximize the total number of pairwise comparisons of proposals while ensuring a balanced coverage of distinct pairs of proposals. We propose an alternative mixed integer linear programming formulation for the reviewer assignment problem. In contrast to the optimization model proposed by Cook et al. (2005), the size of our formulation is polynomial in the input size. We present a semidefinite programming relaxation of our optimization model. Furthermore, we propose an optimization based heuristic approach, in which an optimal solution of the linear programming relaxation or the semidefinite programming relaxation of our optimization model is rounded in a straightforward fashion, followed by a local improvement scheme based on pairwise exchanges of proposals. Our computational results illustrate the effectiveness of our optimization model and our heuristic approach.

Suggested Citation

  • Yeşilçimen, Ali & Yıldırım, E. Alper, 2019. "An alternative polynomial-sized formulation and an optimization based heuristic for the reviewer assignment problem," European Journal of Operational Research, Elsevier, vol. 276(2), pages 436-450.
  • Handle: RePEc:eee:ejores:v:276:y:2019:i:2:p:436-450
    DOI: 10.1016/j.ejor.2019.01.035
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719300700
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2019.01.035?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wade D. Cook & Lawrence M. Seiford, 1982. "On the Borda-Kendall Consensus Method for Priority Ranking Problems," Management Science, INFORMS, vol. 28(6), pages 621-637, June.
    2. Wade D. Cook & Lawrence M. Seiford, 1978. "Priority Ranking and Consensus Formation," Management Science, INFORMS, vol. 24(16), pages 1721-1732, December.
    3. Halicka, M. & de Klerk, E. & Roos, C., 2005. "Limiting behavior of the central path in semidefinite optimization," Other publications TiSEM 82985463-0467-4c61-8be1-1, Tilburg University, School of Economics and Management.
    4. Fan Wang & Ning Shi & Ben Chen, 2010. "A Comprehensive Survey Of The Reviewer Assignment Problem," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 9(04), pages 645-668.
    5. Cook, Wade D. & Kress, Moshe & Seiford, Lawrence M., 1997. "A general framework for distance-based consensus in ordinal ranking models," European Journal of Operational Research, Elsevier, vol. 96(2), pages 392-397, January.
    6. Wade D. Cook & Boaz Golany & Moshe Kress & Michal Penn & Tal Raviv, 2005. "Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking," Management Science, INFORMS, vol. 51(4), pages 655-661, April.
    7. Cook, Wade D., 2006. "Distance-based and ad hoc consensus models in ordinal preference ranking," European Journal of Operational Research, Elsevier, vol. 172(2), pages 369-385, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fujun Hou, 2015. "A Consensus Gap Indicator and Its Application to Group Decision Making," Group Decision and Negotiation, Springer, vol. 24(3), pages 415-428, May.
    2. Hanna Bury & Dariusz Wagner, 2009. "Group judgement with ties. A position-based approach," Operations Research and Decisions, Wroclaw University of Technology, Institute of Organization and Management, vol. 4, pages 9-26.
    3. Amodio, S. & D’Ambrosio, A. & Siciliano, R., 2016. "Accurate algorithms for identifying the median ranking when dealing with weak and partial rankings under the Kemeny axiomatic approach," European Journal of Operational Research, Elsevier, vol. 249(2), pages 667-676.
    4. Hanna Bury & Dariusz Wagner, 2009. "Group judgment with ties. A position-based approach," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 19(4), pages 7-26.
    5. Ignacio Contreras, 2010. "A Distance-Based Consensus Model with Flexible Choice of Rank-Position Weights," Group Decision and Negotiation, Springer, vol. 19(5), pages 441-456, September.
    6. Jabeur, Khaled & Martel, Jean-Marc, 2007. "An ordinal sorting method for group decision-making," European Journal of Operational Research, Elsevier, vol. 180(3), pages 1272-1289, August.
    7. Kelin Luo & Yinfeng Xu & Bowen Zhang & Huili Zhang, 2018. "Creating an acceptable consensus ranking for group decision making," Journal of Combinatorial Optimization, Springer, vol. 36(1), pages 307-328, July.
    8. Cook, Wade D. & Kress, Moshe & Seiford, Lawrence M., 1997. "A general framework for distance-based consensus in ordinal ranking models," European Journal of Operational Research, Elsevier, vol. 96(2), pages 392-397, January.
    9. Cheng, Li-Chen & Chen, Yen-Liang & Chiang, Yu-Chia, 2016. "Identifying conflict patterns to reach a consensus – A novel group decision approach," European Journal of Operational Research, Elsevier, vol. 254(2), pages 622-631.
    10. Yucheng Dong & Yao Li & Ying He & Xia Chen, 2021. "Preference–Approval Structures in Group Decision Making: Axiomatic Distance and Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 273-295, December.
    11. Chen, Yen-Liang & Cheng, Li-Chen, 2009. "Mining maximum consensus sequences from group ranking data," European Journal of Operational Research, Elsevier, vol. 198(1), pages 241-251, October.
    12. Way C.W. Chang & Po-Young Chu & Cherng G. Ding & Soushan Wu, 2000. "Analyzing Ordinal Data for Group Representation," Group Decision and Negotiation, Springer, vol. 9(1), pages 47-61, January.
    13. Sun, Bingzhen & Ma, Weimin, 2015. "An approach to consensus measurement of linguistic preference relations in multi-attribute group decision making and application," Omega, Elsevier, vol. 51(C), pages 83-92.
    14. Jorge Alcalde-Unzu & Marc Vorsatz, 2016. "Do we agree? Measuring the cohesiveness of preferences," Theory and Decision, Springer, vol. 80(2), pages 313-339, February.
    15. Bowen Zhang & Yucheng Dong & Enrique Herrera-Viedma, 2019. "Group Decision Making with Heterogeneous Preference Structures: An Automatic Mechanism to Support Consensus Reaching," Group Decision and Negotiation, Springer, vol. 28(3), pages 585-617, June.
    16. I. Contreras, 2012. "Ordered Weighted Disagreement Functions," Group Decision and Negotiation, Springer, vol. 21(3), pages 345-361, May.
    17. Antonio D’Ambrosio & Carmela Iorio & Michele Staiano & Roberta Siciliano, 2019. "Median constrained bucket order rank aggregation," Computational Statistics, Springer, vol. 34(2), pages 787-802, June.
    18. Michel Truchon, 2005. "Aggregation of Rankings: a Brief Review of Distance-Based Rules," Cahiers de recherche 0534, CIRPEE.
    19. Jorge Alcalde-Unzu & Marc Vorsatz, 2013. "Measuring the cohesiveness of preferences: an axiomatic analysis," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 41(4), pages 965-988, October.
    20. G. Laffond & J. Lainé, 2013. "Unanimity and the Anscombe’s paradox," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(3), pages 590-611, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:276:y:2019:i:2:p:436-450. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.