Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 57C511739E for ; Fri, 25 Sep 2015 15:47:13 +0000 (UTC) Received: (qmail 53274 invoked by uid 500); 25 Sep 2015 15:47:08 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 53147 invoked by uid 500); 25 Sep 2015 15:47:08 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 53136 invoked by uid 99); 25 Sep 2015 15:47:07 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 25 Sep 2015 15:47:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 861FA1A0A80 for ; Fri, 25 Sep 2015 15:47:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.505 X-Spam-Level: X-Spam-Status: No, score=0.505 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HK_RANDOM_ENVFROM=0.626, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id NotXOKpFY2CN for ; Fri, 25 Sep 2015 15:47:07 +0000 (UTC) Received: from mail-la0-f47.google.com (mail-la0-f47.google.com [209.85.215.47]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id A0406207EE for ; Fri, 25 Sep 2015 15:47:06 +0000 (UTC) Received: by lacrr8 with SMTP id rr8so23644449lac.2 for ; Fri, 25 Sep 2015 08:47:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=nFwm/gZuA7YoJ4Fl5vcLEoiCM2KQBpIqsFqfnhCzI5M=; b=Ig4F4VBcQEaN7V+Ca5JC0EwLD27U02woISSEoyB1l+i2TCSimI1k9s2Iavh3Br6cAP 4sloUQElYnklwcj4QWsQo4dX+Du1vF35oJdR3ad/fEdJfWs1c6vbGrU86wJaTkEbwZzB 8Q7XHAUQCdGg+yGhj0MPQu0VMxdaJ9R2iirVRACamXtBnDUfaDTM9eMiYwvFeQQbjp3/ 7Hs0s1/+o/eUIzO+ppRI6idWdoHsdE3YWGPaLgmBMkLg/J+9ysKLX6GpNtDjZDpiZUi+ 4g626SM9R6kj3tM2NaAOfEhdIAn61N7/7cHwcDBaJRmv7f8q1DDSYZWZilqNXHzwnxGt P6BA== X-Received: by 10.112.17.70 with SMTP id m6mr1950140lbd.0.1443196024985; Fri, 25 Sep 2015 08:47:04 -0700 (PDT) Received: from ?IPv6:2a02:6b8::408:85b8:8174:ece0:3bf? ([2a02:6b8:0:408:85b8:8174:ece0:3bf]) by smtp.gmail.com with ESMTPSA id xh10sm451693lbb.33.2015.09.25.08.47.03 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 25 Sep 2015 08:47:04 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Subject: Re: node remains unused after reboot From: Dmitry Sivachenko In-Reply-To: Date: Fri, 25 Sep 2015 18:47:02 +0300 Content-Transfer-Encoding: quoted-printable Message-Id: <9FD12C8B-C70A-4A49-AB49-A0020CBCCFAF@gmail.com> References: <36A18766-3FBD-464B-908E-2965F7768607@gmail.com> <568D9948-B210-4014-82A5-12240560CBD8@gmail.com> <0F708102-A671-44ED-BEF7-C5BBE796572B@apache.org> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.2104) > On 23 =D1=81=D0=B5=D0=BD=D1=82. 2015 =D0=B3., at 22:08, Naganarasimha = Garla wrote: >=20 > Sorry for the late Reply, thought of providing you some search strings = for blackListing hence got lil delayed. > As varun mentioned it looks more like app blacklisting case. = mapreduce.job.maxtaskfailures.per.tracker which is by default 3, so = probability as per the scenario mentioned by you is that the node is = getting black listed. > You can search for Info logs with string as "Blacklisted host " = from RMContainerRequestor class. >=20 Thanks for the hint! Yes, I see from the logs that this node was blacklisted.