Trang chủ / Tin tức / Khoa học & công nghệ
Khoa học & công nghệ

The Recall Ceiling of LLM Recommendation Reranking

03/11/2026 · Thành viên: PGS.TS Nguyễn Chấn Hùng · Nguồn: OpenAlex

Some LLM-based recommendation rerankers are evaluated under an oracle protocol that guarantees the ground-truth item is present in the scored set, either by injecting it into the candidate list or...

<p><strong>Tác giả:</strong> Zhaohui Wang</p>

<p>Some LLM-based recommendation rerankers are evaluated under an oracle protocol that guarantees the ground-truth item is present in the scored set, either by injecting it into the candidate list or by scoring it against sampled negatives. We show that this protocol overestimates realistic performance by 92-95% in NDCG@10 across three primary Amazon datasets, so oracle results do not transfer to deployment. The root cause is a recall ceiling: realistic retrieval covers only 2-19% of relevant it...</p>

<p>📄 DOI: <a href="https://doi.org/https://doi.org/10.1145/3799682.3841132" target="_blank" rel="noopener">https://doi.org/10.1145/3799682.3841132</a></p>

<p>📖 <a href="https://doi.org/https://doi.org/10.1145/3799682.3841132" target="_blank" rel="noopener">Xem bài báo đầy đủ</a></p>

Bài viết được biên soạn lại bởi LIFVietnam. Nguồn tham khảo: OpenAlex