lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitry Kan <solrexp...@gmail.com>
Subject Re: iterate through each document in Solr
Date Mon, 06 May 2013 10:33:01 GMT
Are you doing it once? Is your index sharded? If so, can you ask each shard
individually?
Another way would be to do it on Lucene level, i.e. read from the binary
indices (API exists).

Dmitry


On Mon, May 6, 2013 at 5:48 AM, Mingfeng Yang <mfyang@wisewindow.com> wrote:

> Dear Solr Users,
>
> Does anyone know what is the best way to iterate through each document in a
> Solr index with billion entries?
>
> I tried to use  select?q=*:*&start=xx&rows=500  to get 500 docs each time
> and then change start value, but it got very slow after getting through
> about 10 million docs.
>
> Thanks,
> Ming-
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message