lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley" <yo...@apache.org>
Subject Re: Resolr performance
Date Thu, 04 Dec 2008 13:48:18 GMT
On Thu, Dec 4, 2008 at 8:36 AM, sunnyfr <johanna.34@gmail.com> wrote:
> When I check my CPU, all my CPU are not full, how can I change this ?

If this is while you are indexing, then it simply means that you are
not feeding documents to Solr fast enough (use multiple threads to
send to Solr, and send multiple documents in each update request if
possible).  If CPU utilization is still low, then it means you are IO
(disk) bound... if you want to go faster, get faster disks.

-Yonik

> Do I have to change a parameter ??
>
> Thanks a lot ,
> Johanna
>
>
> Walter Underwood wrote:
>>
>> Try running your submits while watching a CPU load meter.
>> Do this on a multi-CPU machine.
>>
>> If all CPUs are busy, you are running as fast as possible.
>>
>> If one CPU is busy (around 50% usage on a dual-CPU system),
>> parallel submits might help.
>>
>> If no CPU is 100% busy, the bottleneck is probably disk
>> or network.
>>
>> wunder
>>
>> On 2/20/07 10:46 AM, "Jack L" <jlist9@yahoo.ca> wrote:
>>
>>> Thanks to all who replied. It's encouraging :)
>>>
>>> The numbers vary quite a bit though, from 13 docs/s (Burkamp)
>>> to 250 docs/s (Walter) to 1000 docs/s I understand the results also
>>> depend
>>> on the doc size and hardware.
>>>
>>> I have a question for Erik: you mentioned "single threaded indexer"
>>> (below). I'm not familiar with solr at all and did a search on solr
>>> wiki for "thread" and didn't find anything. Is it so that I can
>>> actually configure solr to be single-threaded and multi-threaded?
>>>
>>> And I'm not sure what you meant by parallelizing the indexer?
>>> Running multiple instances of the indexer, or multiple instances
>>> of solr?
>>>
>>> Thanks,
>>>
>>> Jack
>>>
>>>> My largest Solr index is currently at 1.4M and it takes a max of 3ms
>>>> to add a document (according to Solr's console), most of them 1ms.
>>>> My single threaded indexer is indexing around 1000 documents per
>>>> minute, but I think I can get this number even faster by
>>>> parallelizing the indexer.
>>>
>>>
>>> __________________________________________________
>>> Do You Yahoo!?
>>> Tired of spam?  Yahoo! Mail has the best spam protection around
>>> http://mail.yahoo.com
>>
>>
>>
>
> --
> View this message in context: http://www.nabble.com/solr-performance-tp9055437p20833521.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

Mime
View raw message