hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rahul malviya <malviyarahul2...@gmail.com>
Subject Re: MR against snapshot causes High CPU usage on Datanodes
Date Wed, 13 May 2015 16:58:33 GMT
Short circuit read can cause it to spike CPU and IO wait issues ?

Rahul

On Wed, May 13, 2015 at 9:41 AM, rahul malviya <malviyarahul2001@gmail.com>
wrote:

> Yes.
>
> On Wed, May 13, 2015 at 9:40 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> Have you enabled short circuit read ?
>>
>> Cheers
>>
>> On Wed, May 13, 2015 at 9:37 AM, rahul malviya <
>> malviyarahul2001@gmail.com>
>> wrote:
>>
>> > Hi,
>> >
>> > I have recently started running MR on hbase snapshots but when the MR is
>> > running there is pretty high CPU usage on datanodes and I start seeing
>> IO
>> > wait message in datanode logs and as soon I kill the MR on Snapshot
>> > everything come back to normal.
>> >
>> > What could be causing this ?
>> >
>> > I am running cdh5.2.0 distribution.
>> >
>> > Thanks,
>> > Rahul
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message