hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ivan Frain <ivan.fr...@gmail.com>
Subject Re: Hadoop/Lucene + Solr architecture suggestions?
Date Wed, 10 Oct 2012 05:20:54 GMT
Hi Mark,

I don't know Lucene/Solr very well but your question made me remember the
lily project: http://www.lilyproject.org/lily/index.html. They use
hadoop/hbase and solr to provide a searchable data management platform.

Maybe you will find ideas in their documentation.

BR,
Ivan

2012/10/10 Mark Kerzner <mark.kerzner@shmsoft.com>

> Hi,
>
> if I create a Lucene index in each mapper, locally, then copy them to
> under /jobid/mapid1, /jodid/mapid2, and then in the reducers copy them to
> some Solr machine (perhaps even merging), does such architecture makes
> sense, to create a searchable index with Hadoop?
>
> Are there links for similar architectures and questions?
>
> Thank you. Sincerely,
> Mark
>



-- 
Ivan Frain
11, route de Grenade
31530 Saint-Paul-sur-Save
mobile: +33 (0)6 52 52 47 07

Mime
View raw message