hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrzej Bialecki ...@getopt.org>
Subject Re: Hadoop + Lucene integration: possible? how?
Date Mon, 15 Jan 2007 13:19:13 GMT
maarten@sherpa-consulting.be wrote:
> Thanks Andrzej,
>
> let's me quickly explain my situation:
>
> I'm developing an application which is partially based upon 'tags' 
> (the new hype lolz), instead of suing rdmbs for full text searching 
> the tag list / item I'll be using Lucene. The application will have 
> about 100000 visitors / day, mostly / only searching and not adding 
> stuff. I have, at the moment, no idea on how the performance will be 
> when all these users will be hitting Lucene. That was why I was 
> looking at a distributed solution and found Hadoop. So I'll be adding 
> and removing indexes, is removing possible on Hadoop, because you 
> mentioned read-only?
>
> You have any idea whether the scenario above can easily be handled by 
> Lucene (best guess) or that idd I'll be needing some kind of DFS? And 
> if so you have any suggestions?
>

I think Solr would be a better platform for this. Hadoop is useful if 
you really need a distributed filesystem metaphor, which you don't 
really need - you need a distributed service.

-- 
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com



Mime
View raw message