lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley" <yo...@apache.org>
Subject Re: Can't add new data or optimize
Date Mon, 30 Oct 2006 22:33:16 GMT
On 10/30/06, Kevin Lewandowski <kevinsl@gmail.com> wrote:
> I'm no longer able to add new data or optimize my index. There are
> currently 1600 files in the index directory and it's about 1.1gb. I've
> tried changing solrconfig.xml to use the compound file format and that
> didn't make a difference. My ulimit is "unlimited" but I've tried
> setting it at 1000000 and restarting tomcat but tomcat wouldn't start
> after doing that.
>
> I'm not sure what else can be done. Any ideas?

What are your index stats? number of indexed fields, maxBufferedDocs,
maxMergeDocs, mergeFactor, etc?

1600 files sounds like too many, unless they are no longer part of the
active index and are just left over from previous merge failures.


A ulimit of 8192 is normally more than enough.... depending on the OS,
raising the limit could take extra resources, so don't set it as high
as you can.
Be aware that using "ulimit" to change the number of open files or
file descriptors is probably only setting the "soft" limit, and not
the system-wide hard limit (which may be 1024 unless you change it)

http://www.google.com/search?q=linux+ulimit+hard+limit

-Yonik

Mime
View raw message