Trang chủ / Tin tức / Khoa học & công nghệ
Khoa học & công nghệ

Judging a Review by its Cover: A Reliability Analysis of LLM-based Peer Review Evaluation Metrics

03/11/2026 · Thành viên: Ông. Nguyễn Việt Anh · Nguồn: OpenAlex

Peer-review evaluation is increasingly being automated with LLM-as-a-judge metrics, but this creates a measurement risk. A review may receive a high score because it is fluent, organized, and polis...

<p><strong>Tác giả:</strong> Shakiba Amirshahi, Sajad Ebrahimi, Hai Son Le, Negar Arabzadeh, Ebrahim Bagheri A</p>

<p>Peer-review evaluation is increasingly being automated with LLM-as-a-judge metrics, but this creates a measurement risk. A review may receive a high score because it is fluent, organized, and polished, rather than because it provides a strong evaluation of the paper. This risk is especially important in AI-assisted reviewing, where reviewers may use LLMs to improve clarity or presentation while preserving the underlying judgments. We propose a statistical framework for testing whether peer-re...</p>

<p>📄 DOI: <a href="https://doi.org/https://doi.org/10.1145/3799682.3840033" target="_blank" rel="noopener">https://doi.org/10.1145/3799682.3840033</a></p>

<p>📖 <a href="https://doi.org/https://doi.org/10.1145/3799682.3840033" target="_blank" rel="noopener">Xem bài báo đầy đủ</a></p>

Bài viết được biên soạn lại bởi LIFVietnam. Nguồn tham khảo: OpenAlex