Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AFBD81101B for ; Tue, 10 Jun 2014 01:59:19 +0000 (UTC) Received: (qmail 35905 invoked by uid 500); 10 Jun 2014 01:59:15 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 35755 invoked by uid 500); 10 Jun 2014 01:59:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 35748 invoked by uid 99); 10 Jun 2014 01:59:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jun 2014 01:59:13 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of hadoop.ca@gmail.com designates 209.85.160.49 as permitted sender) Received: from [209.85.160.49] (HELO mail-pb0-f49.google.com) (209.85.160.49) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Jun 2014 01:59:08 +0000 Received: by mail-pb0-f49.google.com with SMTP id jt11so5649004pbb.22 for ; Mon, 09 Jun 2014 18:58:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=YvmQ7Qz6WTzhxsD93Wd9uMFx8wApR9lBbMLpH4ZbWIM=; b=T/O2d3jTYg05TTYc835PScHdtL5W8vgYjOkXaeyWjy4Xr09LCHaVT4XZ8FTnCSsNle qvRVi1ZWpzb+LKt8372wYxkc0HG2M9wZ+EH4PTztENTZagqZAxjuRzMkmOLkbTCXtEqV VGmwb9YlC+yptSojrUHVfFbxx/1Ze/vwZlmdOkt41e3fFipR/3ZEET6rHsv1v+BEiq4X OOtKAcntiMNNBHurM73JhUz7QfBy1yowtVgNMrzG3KUcYU/rnyLTMQDmVLvaDMCzEDHF XAm8JAcM0q3PMeYehxB2yPou+w0I2Y9IINgap95XkNqvvmXKTMEE1GyzxxLDEp5bbNC5 V21w== X-Received: by 10.66.251.136 with SMTP id zk8mr1965628pac.137.1402365524263; Mon, 09 Jun 2014 18:58:44 -0700 (PDT) Received: from [100.108.254.223] (mad2736d0.tmodns.net. [208.54.39.173]) by mx.google.com with ESMTPSA id bx5sm8817407pbd.69.2014.06.09.18.58.43 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 09 Jun 2014 18:58:43 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: Idle tasktracker eats CPU From: Serge Blazhievsky X-Mailer: iPhone Mail (11B651) In-Reply-To: <6C662AEB-8949-4502-A46C-5C2BD238F36F@gmail.com> Date: Mon, 9 Jun 2014 18:58:42 -0700 Cc: "user@hadoop.apache.org" Content-Transfer-Encoding: quoted-printable Message-Id: <7659C6ED-BB50-4BC0-954A-97F899F410B9@gmail.com> References: <6C662AEB-8949-4502-A46C-5C2BD238F36F@gmail.com> To: "user@hadoop.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org There are ongoing pings to jobtracker=20 But 10% seems high Sent from my iPhone > On Jun 9, 2014, at 2:15, Dmitry Sivachenko wrote: >=20 > Hello! >=20 > I set up hadoop-1.2.1 on FreeBSD-10/stable with openjdk version 1.7.0_60. >=20 > On the first glance it is doing well except one annoying thing: after exe= cuting some tasks, tasktracker process starts to eat CPU when idle. > Sometimes it is 10-20% (numbers from top(1) output), sometimes it is 100-1= 50%. >=20 > In tasktrackers's log I see numerious records like this: >=20 > 2014-06-09 13:08:29,858 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - injecting delay59 times > 2014-06-09 13:08:29,859 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - recreating selector 59 times, canceled= keys 944 times > 2014-06-09 13:09:29,862 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - injecting delay58 times > 2014-06-09 13:09:29,862 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - recreating selector 58 times, canceled= keys 928 times > 2014-06-09 13:10:29,901 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - injecting delay58 times > 2014-06-09 13:10:29,901 INFO org.mortbay.log: org.mortbay.io.nio.SelectorM= anager$SelectSet@abdcc1c JVM BUG(s) - recreating selector 58 times, canceled= keys 928 times >=20 >=20 > Is it a known thing? Is there any workaround available? >=20 > Thanks in advance.