hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dmitry Sivachenko <trtrmi...@gmail.com>
Subject Re: Idle tasktracker eats CPU
Date Tue, 10 Jun 2014 03:24:23 GMT

On 10 июня 2014 г., at 5:58, Serge Blazhievsky <hadoop.ca@gmail.com> wrote:

> There are ongoing pings to jobtracker 
> 
> But 10% seems high


Sometimes it is 10%, sometimes it is 200+%.
Different nodes, different numbers.

So pings can't explain that.



> 
> Sent from my iPhone
> 
>> On Jun 9, 2014, at 2:15, Dmitry Sivachenko <trtrmitya@gmail.com> wrote:
>> 
>> Hello!
>> 
>> I set up hadoop-1.2.1 on FreeBSD-10/stable with openjdk version 1.7.0_60.
>> 
>> On the first glance it is doing well except one annoying thing:  after executing
some tasks, tasktracker process starts to eat CPU when idle.
>> Sometimes it is 10-20% (numbers from top(1) output), sometimes it is 100-150%.
>> 
>> In tasktrackers's log I see numerious records like this:
>> 
>> 2014-06-09 13:08:29,858 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - injecting delay59 times
>> 2014-06-09 13:08:29,859 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - recreating selector 59 times, canceled keys 944 times
>> 2014-06-09 13:09:29,862 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - injecting delay58 times
>> 2014-06-09 13:09:29,862 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - recreating selector 58 times, canceled keys 928 times
>> 2014-06-09 13:10:29,901 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - injecting delay58 times
>> 2014-06-09 13:10:29,901 INFO org.mortbay.log: org.mortbay.io.nio.SelectorManager$SelectSet@abdcc1c
JVM BUG(s) - recreating selector 58 times, canceled keys 928 times
>> 
>> 
>> Is it a known thing?  Is there any workaround available?
>> 
>> Thanks in advance.


Mime
View raw message