Some LLM-based recommendation rerankers are evaluated under an oracle protocol that guarantees the ground-truth item is present in the scored set, either by injecting it into the candidate list or...
<p><strong>Tác giả:</strong> Zhaohui Wang</p>
<p>Some LLM-based recommendation rerankers are evaluated under an oracle protocol that guarantees the ground-truth item is present in the scored set, either by injecting it into the candidate list or by scoring it against sampled negatives. We show that this protocol overestimates realistic performance by 92-95% in NDCG@10 across three primary Amazon datasets, so oracle results do not transfer to deployment. The root cause is a recall ceiling: realistic retrieval covers only 2-19% of relevant it...</p>
<p>📄 DOI: <a href="https://doi.org/https://doi.org/10.1145/3799682.3841132" target="_blank" rel="noopener">https://doi.org/10.1145/3799682.3841132</a></p>
<p>📖 <a href="https://doi.org/https://doi.org/10.1145/3799682.3841132" target="_blank" rel="noopener">Xem bài báo đầy đủ</a></p>
Bài viết được biên soạn lại bởi LIFVietnam. Nguồn tham khảo: OpenAlex
