lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hoss Man (JIRA)" <j...@apache.org>
Subject [jira] Commented: (LUCENE-527) Bug in the TermDocs.freq() method?
Date Mon, 20 Mar 2006 08:13:00 GMT
    [ http://issues.apache.org/jira/browse/LUCENE-527?page=comments#action_12371047 ] 

Hoss Man commented on LUCENE-527:
---------------------------------

This is not a valid test case.

>From the documentation for TermDocs.skipTo...

Skips entries to the first beyond the current whose document number is greater than or equal
to target.

It returns true or false to indicate if there was any such entry, and the doc() method should
be used to check and see what the first document it found was -- you can't assume it will
be the same as the docId you specified.

i believe the test will demonstrate what you expect, if you replace your j-loop with...

for (int j=0; j<terms.length; j++){
    TermDocs td = reader.termDocs( new Term("contents", terms[j]) );
    if (td.skipTo(docID) && td.doc() == docID) {
        System.out.println( "Term '" + terms[j] + "' occures " +
                            td.freq() + " time(s) in document nr. " + docID );
    }
}





> Bug in  the TermDocs.freq() method?
> -----------------------------------
>
>          Key: LUCENE-527
>          URL: http://issues.apache.org/jira/browse/LUCENE-527
>      Project: Lucene - Java
>         Type: Bug
>     Versions: 1.9
>  Environment: Scientific linux
>     Reporter: HÃ¥kon T. Bommen

>
> I belive I get incorrect data from the TermDocs.freq() method. The attached code demonstrate
this. Document one has correct term count. In document zero and two, the term "stored" and
"indexed" is reported to occure once in both documents. This is incorrect.
> // LuceneTest.java
> import org.apache.lucene.analysis.Analyzer;
> import org.apache.lucene.analysis.standard.StandardAnalyzer;
> import org.apache.lucene.queryParser.ParseException;
> import org.apache.lucene.document.*;
> import org.apache.lucene.index.*;
> import org.apache.lucene.search.*;
> import org.apache.lucene.queryParser.QueryParser;
> import org.apache.lucene.store.RAMDirectory;
> import org.apache.lucene.store.Directory;
> public class LuceneTest{
> 	public LuceneTest(){}
>     public static void main(String[] args){
> 		IndexWriter writer;
> 		IndexReader reader;
> 		Searcher searcher;
> 		Document doc;
> 		Directory dir = new RAMDirectory();
> 		try{
> 			// create index
> 			writer = new IndexWriter( dir , new StandardAnalyzer(), true);
> 			doc = new Document();
> 			doc.add( new Field( "title", "Doc 0", Field.Store.YES, Field.Index.TOKENIZED ) );
> 			doc.add( new Field( "contents", "Text Text and more Text", Field.Store.NO, Field.Index.TOKENIZED
) );
> 			writer.addDocument(doc);
> 			doc = new Document();
> 			doc.add( new Field( "title", "Doc 1", Field.Store.YES, Field.Index.TOKENIZED ) );
> 			doc.add( new Field( "contents", "This text is not stored, only indexed.", Field.Store.NO,
Field.Index.TOKENIZED ) );
> 			writer.addDocument(doc);
> 			doc = new Document();
> 			doc.add( new Field( "title", "Doc 2", Field.Store.YES, Field.Index.TOKENIZED ) );
> 			doc.add( new Field( "contents", "Text Text Text Text", Field.Store.NO, Field.Index.TOKENIZED
) );
> 			writer.addDocument(doc);
> 			writer.close();
> 			// search
> 			searcher = new IndexSearcher(dir);
> 			reader = IndexReader.open(dir);
> 			QueryParser qp = new QueryParser("contents", new StandardAnalyzer());
>             Query query = qp.parse("stored and indexed text");
>         	String[] terms = {"stored", "indexed", "text"};
> 			Hits queryHits = searcher.search(query);
> 			// print results
> 			System.out.println( "Found " + queryHits.length() + " hits.");
> 			for(int i=0; i<queryHits.length(); i++){
> 				doc = queryHits.doc(i);
> 				System.out.println("*** " + doc.get("title") + " ***");
> 				int docID = queryHits.id(i);
> 				for (int j=0; j<terms.length; j++){
> 					TermDocs td = reader.termDocs( new Term("contents", terms[j]) );
> 					td.skipTo(docID);
> 					System.out.println( "Term '" + terms[j] + "' occures " +
> 						td.freq() + " time(s) in document nr. " + docID );
> 				}
> 			}
> 		}catch(Exception e){System.out.println("Darn");}
> 	}
> }

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


Mime
View raw message