hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Slava Gorelik" <slava.gore...@gmail.com>
Subject Re: Regionserver fails to serve region
Date Wed, 05 Nov 2008 10:39:34 GMT
Hi Michael.I'm sending logs, in 2 parts (2 messages)
Part 1


On Tue, Nov 4, 2008 at 11:44 PM, Slava Gorelik <slava.gorelik@gmail.com>wrote:

> Thank You. Now it's clear.
>
>
> On Tue, Nov 4, 2008 at 11:31 PM, stack <stack@duboce.net> wrote:
>
>> Slava Gorelik wrote:
>>
>>> One more regarding the blockCache, how changes in store files (as i
>>> understand those are MapFiles) are reflected on client side cache. If we
>>> are
>>> talking about more than one client that doing a changes ? If each client
>>> has
>>> different part of the MapFile ? or something else ?
>>>
>>>
>>
>> The block cache cache is over in the server. Its a cache for store files
>> which never change once written.  Did I say client-side cache?  I should
>> have been more clear.  The client in this case is the regionserver itself.
>> The cache is so the regionserver saves on its trips over the network
>> visiting datanodes.
>> St.Ack
>>
>>
>>
>>  Best Regards.
>>>
>>> On Tue, Nov 4, 2008 at 11:10 PM, Slava Gorelik <slava.gorelik@gmail.com
>>> >wrote:
>>>
>>>
>>>
>>>> I can try to reproduce it again, but before this i would like to send
>>>> you a
>>>> logs.
>>>> Best Regards.
>>>>
>>>>
>>>> On Tue, Nov 4, 2008 at 10:05 PM, stack <stack@duboce.net> wrote:
>>>>
>>>>
>>>>
>>>>> Then we should try and figure if there is an issue in the balancer, or
>>>>> maybe there is something missing if we are not doing a big upload in
a
>>>>> manner that balances the upload across HDFS?
>>>>> St.Ack
>>>>>
>>>>> Slava Gorelik wrote:
>>>>>
>>>>>
>>>>>
>>>>>> Sure, i'll arrange logs tomorrow.About balancer, to wait when the
>>>>>> massive
>>>>>> work is finished is good in testing environment but in production
it's
>>>>>> not
>>>>>> relevant :-)
>>>>>>
>>>>>> Best Regards.
>>>>>>
>>>>>> On Tue, Nov 4, 2008 at 9:48 PM, stack <stack@duboce.net> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>> Slava Gorelik wrote:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> Hi.Regarding the failure of new block creation - i failed
to run
>>>>>>>> hbase
>>>>>>>> till
>>>>>>>> i reformatted HDFS again.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> I'd be interested in the logs.
>>>>>>>
>>>>>>>  I just wandering if hadoop re balancing is necessary? Will it
>>>>>>> balance
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> itself
>>>>>>>> ? As i understand hadoop balancer is moving data between
data nodes,
>>>>>>>> but
>>>>>>>> in
>>>>>>>> my case this is during massive (8 clients just adding a records
-
>>>>>>>> about
>>>>>>>> 400
>>>>>>>> requests for all region servers - 6). So, is it good idea
to run
>>>>>>>> balancer during heavy load ?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> I don't have sufficient experience running the balancer.  Perhaps
>>>>>>> wait
>>>>>>> till
>>>>>>> upload is done, then run it?
>>>>>>>
>>>>>>> St.Ack
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>>
>

Mime
View raw message