lucene-java-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-java Wiki] Update of "OpenRelevance" by SteveRowe
Date Mon, 11 May 2009 17:16:13 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-java Wiki" for change notification.

The following page has been changed by SteveRowe:
http://wiki.apache.org/lucene-java/OpenRelevance

The comment on the change is:
Added link to SIGIR paper about crowdsourcing relevance judgments

------------------------------------------------------------------------------
  
  == Relevance Judgments ==
  
- Unlike TREC, we will focus only on relevance judgments for the top ten or twenty results.
 We will need to figure out a way to "pool" and/or validate the results.  Again, a wikipedia
still approach may work here.  NOTE: There was a SIGIR poster/paper a little while ago about
crowd-sourcing relevance judgments.  Link to it here.
+ Unlike TREC, we will focus only on relevance judgments for the top ten or twenty results.
 We will need to figure out a way to "pool" and/or validate the results.  Again, a wikipedia
still approach may work here.  '''NOTE: There was a SIGIR poster/paper a little while ago
about crowd-sourcing relevance judgments.  Link to it here.'''
+ 
+ * ''Is this it?'': [http://portal.acm.org/citation.cfm?id=1390450 Relevance judgments between
TREC and Non-TREC assessors] ([http://ir.shef.ac.uk/cloughie/papers/pp908-almaskari.pdf Alternate
link])
  
  
  = Next Steps =

Mime
View raw message