hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Can I move block data directly?
Date Mon, 08 Jul 2013 07:10:27 GMT
Yeah you're right. I only meant the ownership of the blk_* files to be
owned by the same user as the DN daemon, for consistency more than
anything else.

On Mon, Jul 8, 2013 at 11:46 AM, Azuryy Yu <azuryyyu@gmail.com> wrote:
> bq. I'd also ensure the ownership of the block files are intact.
> Hi Harsh,
>
> what's mean "ensure the ownership of the block files are intact"?
>
> and I want to ask more.
>
> for my understand, after I restart the data node daemon, block report should
> tell NN all blocks owned by this DN, and block scnaner can remember all
> blocks' structure on local, so the block file owner ship would be confirmed
> at the starting period
>
> and even if some pieces of blk_ files losts, then NN an find it's under
> replicated, am I right?  Thanks.
>
>
>
>
> On Mon, Jul 8, 2013 at 2:07 PM, Azuryy Yu <azuryyyu@gmail.com> wrote:
>>
>> Thanks Harsh, always detailed answers each time.
>>
>> Yes, this is an unsupported scenarios, Load balancer is very slow even
>> after I set bandwidthPerSec  to a large value, so I want to take this way to
>> slove the problem quickly.
>>
>>
>>
>>
>>
>>
>> On Mon, Jul 8, 2013 at 1:46 PM, Viral Bajaria <viral.bajaria@gmail.com>
>> wrote:
>>>
>>> Out of curiosity. Besides the bandwidthPerSec and threshold what other
>>> parameters are tuneable ?
>>>
>>> Thanks,
>>> Viral
>>>
>>> On Sun, Jul 7, 2013 at 10:39 PM, Harsh J <harsh@cloudera.com> wrote:
>>>>
>>>> If balancer isn't cutting it out for you with stock defaults, you
>>>> should consider tuning that than doing these unsupported scenarios.
>>>
>>>
>>>
>>
>



-- 
Harsh J

Mime
View raw message