lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Pressed optimize and now SOLR is not indexing while optimize is going on
Date Tue, 06 Oct 2015 00:23:47 GMT
bq:  Would having an SSD make considerable difference in
speed

Almost certainly. Optimize is rarely necessary, especially if
you're indexing relatively constantly so just avoiding that might
do the trick ;).

But reloading shouldn't be taking 10 minutes. Before 5.2, if you
had suggesters configured in your solrconfig.xml (and in some
versions, it was enabled by default), then a _very_ expensive
rebuild would happen whenever the core loaded, you might
want to check that.
see: https://issues.apache.org/jira/browse/SOLR-6845

The other possibility is that you had a very large transaction log
and abnormally shut Solr down (kill -9 for instance) and the tlog
would be replayed. You get a large tlog by indexing a bunch
of stuff and not doing a hard commit, see:
https://lucidworks.com/blog/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/

Best,
Erick

On Mon, Oct 5, 2015 at 2:26 PM, Siddhartha Singh Sandhu
<sandhusolr@gmail.com> wrote:
> Thank you Eric. I think your explanation was the reason.
>
> Following up on that: Would having an SSD make considerable difference in
> speed?
>
> On Mon, Oct 5, 2015 at 5:18 PM, Siddhartha Singh Sandhu <
> sandhusolr@gmail.com> wrote:
>
>> Scrap the last one. It just took 10 mins to load. I panicked too quick.
>>
>> On Mon, Oct 5, 2015 at 5:15 PM, Siddhartha Singh Sandhu <
>> sandhusolr@gmail.com> wrote:
>>
>>> I restarted my SOLR and it is now not reloading the configuration.
>>> Is my solr index corrupted?
>>>
>>> Sid.
>>>
>>> On Mon, Oct 5, 2015 at 5:09 PM, Erick Erickson <erickerickson@gmail.com>
>>> wrote:
>>>
>>>> You should be able to insert while optimizing. Do be aware that
>>>> optimize will probably require that your disk have free _at least_ as
>>>> much space as the index takes up.
>>>>
>>>> It may just be that the disk is so busy with the optimize (it's mostly
>>>> just writing from one file to another) that it's appearing to be
>>>> slow...
>>>>
>>>> Best,
>>>> Erick
>>>>
>>>> On Mon, Oct 5, 2015 at 1:52 PM, Siddhartha Singh Sandhu
>>>> <sandhusolr@gmail.com> wrote:
>>>> > Hi,
>>>> >
>>>> > I pressed the optimize switch. Wasn't the best decision I made today.
>>>> The
>>>> > aftermath of it was that when I tried to index more documents the curl
>>>> just
>>>> > waited and waited.
>>>> >
>>>> > I pinged my SOLR and all is well. I am able to access the admin console
>>>> > also. I can query the SOLR machine too. But, I cannot insert into the
>>>> > index. Is this behavior normal?
>>>> >
>>>> > Regards,
>>>> >
>>>> > Sid.
>>>>
>>>
>>>
>>

Mime
View raw message