hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patai Sangbutsarakum <silvianhad...@gmail.com>
Subject Re: Linux io scheduler
Date Wed, 03 Apr 2013 17:25:43 GMT
Thanks Chris for response, I would love to try out. What would be the
metric(s) that we will be use to measure if we improve thing.?


On Tue, Apr 2, 2013 at 11:24 AM, Chris Embree <cembree@gmail.com> wrote:

> I assume your talking about the I/O scheduler.  Based on normal advice,
> only change this if you have a "smart" device between the OS and the
> Drives.  A SATA controller usually qualifies.  I have our DataNodes to to
> NOOP to reduce the number of layers.
>
> As always your mileage may vary and you should do some testing on your own.
>
>
> On Tue, Apr 2, 2013 at 1:59 PM, Patai Sangbutsarakum <
> silvianhadoop@gmail.com> wrote:
>
>> Hello Hadoopers,
>>
>> Is anyone ever play linux io scheduler configuration in worker nodes?
>> default for centos is cfq, there are 3 more to choose from.
>> I wonder if we can play with those scheduler, probably we might get
>> better performance ?
>>
>> hope this make sense.
>> Patai
>>
>
>

Mime
View raw message