lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Renaud Delbru <renaud.del...@deri.org>
Subject Posting List Encoding: Group Varint Encoding
Date Tue, 05 May 2009 13:33:12 GMT
Hi,

I know that a new encoding technique, PFOR, is being implemented in the 
Lucene project [1]. Have you heard about the "Group Varint" encoding 
technique from Google ? There is a technical explanation in the talk of 
Jeffrey Dean, "Challenges in Building Large-Scale Information Retrieval 
Systems" (44:02). From the talk, this technique seems quite fast in 
decoding: 400M numbers/second against 180M numbers/second for normal 
Vint encoding; and it seems easy to implement.
It will be maybe interesting to benchmark it against PFOR.

[1] http://issues.apache.org/jira/browse/LUCENE-1410
[2] http://videolectures.net/wsdm09_dean_cblirs/
-- 
Renaud Delbru

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message