lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Earwin Burrfoot <ear...@gmail.com>
Subject Re: LuceneTestCase.threadCleanup incorrectly reports left running threads
Date Sat, 25 Dec 2010 14:05:48 GMT
I think we can take some public algos like lookup3 / murmurhash2/3,
and stuff them into Lucene utils.

Java implementations (very simple and fast ones) exist for both of these.

I.e. lookup3 done by Yonik (http://people.apache.org/~yonik/code/hash/),
murmurhash2 - by Andrzej Bialecki (
http://www.getopt.org/murmur/MurmurHash.java ) used in Hadoop?
non-compatible with original?,
a version by Derek Young (
http://dmy999.com/article/50/murmurhash-2-java-port ),
a version by Ted Dunning for Mahout,
a random version off Google by Viliam Holub (
http://d3s.mff.cuni.cz/~holub/sw/javamurmurhash/ )

lookup3 defines versions returning 32/64bit hashes, murmurhash2 -
32/64bit, murmurhash3 - 32/64/128bit

They are just generally useful for many text-processing apps.

On Sat, Dec 25, 2010 at 16:20, Robert Muir <rcmuir@gmail.com> wrote:
> On Sat, Dec 25, 2010 at 4:04 AM, Uwe Schindler <uwe@thetaphi.de> wrote:
>> Md5 is guaranteed to be there (like utf8 as charset). This is documented in crypto
Api, which algorithms are available for digest.
>>
>
> where is this documented? its not in the javadocs.
>
> anyway, we shouldn't be doing this:
> * this algorithm might not exist on J2ME etc (still java), you need to
> install an extra crypto add-on.
> * we shouldnt start up an expensive PKI infrastructure on mac os X,
> including spawning a new thread, just to hash a string. thats absurd.
> * we pay all these costs ... for md5! its not even a good hash!
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>



-- 
Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
Phone: +7 (495) 683-567-4
ICQ: 104465785

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message