Abstract
Average gain ratio which is based on the idea of cumulative gain and is used for evaluation with multiple relevance levels, is proposed. Cumulative gain assumes that an imaginary user scans the ranked output from the top, and 'gains' an additional score each time he finds a relevant document. Average gain ratio was proposed as a modification of weighted average precision. The results show that average gain ratio is more suitable for averaging across topics and is more robust to the variation in the number of relevant documents at each relevance level.
| Original language | English |
|---|---|
| Pages (from-to) | 417-418 |
| Number of pages | 2 |
| Journal | SIGIR Forum (ACM Special Interest Group on Information Retrieval) |
| Issue number | SPEC. ISS. |
| Publication status | Published - 2003 Dec 1 |
| Externally published | Yes |
| Event | Proceedings of the Twenty-Sixth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2003 - Toronto, Ont., Canada Duration: 2003 Jul 28 → 2003 Aug 1 |
Keywords
- Average Gain Ratio
- Retrieval Performance
ASJC Scopus subject areas
- Management Information Systems
- Hardware and Architecture