Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4C7331178F for ; Tue, 15 Apr 2014 19:03:47 +0000 (UTC) Received: (qmail 51801 invoked by uid 500); 15 Apr 2014 19:03:39 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 51571 invoked by uid 500); 15 Apr 2014 19:03:38 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 51564 invoked by uid 99); 15 Apr 2014 19:03:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2014 19:03:38 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ashettia@hortonworks.com designates 209.85.214.181 as permitted sender) Received: from [209.85.214.181] (HELO mail-ob0-f181.google.com) (209.85.214.181) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Apr 2014 19:03:33 +0000 Received: by mail-ob0-f181.google.com with SMTP id gq1so1385725obb.12 for ; Tue, 15 Apr 2014 12:03:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=AzjaNwu2AnTNsbBX4PxjF5QkOGYWExg7pfgz302Cm0c=; b=cV6FOW4j4i4SKYWbhkB2KLdPpcm2twOVDFnRW5QvdGXeQ1WaTL7ypwZQlHzsttVWZ4 7UIqcJ/cBA3ltLiC/mGGXwd2u/6CelyVFxZvswzSj+TTvmHaqIng7ZP+Adx9y+9TRkbQ i08kVmqHcKmFe1wJ8jsw+xvJZWzj8l60NRUyATG+D/Ly+pLkyJ3fXLC6sjg2HsSOAYU+ gfTlH54dJKqDhV6r4fMgRweJDmh/DfVWD4DEiA/uXj2avKF6MpSRBdgHdjfXpx6Pyd+t JkiFAOuloSP9o3VEHPjARJtqfIehegHML+RUhqpgB/no3nz8VXvqYNibI9LlKs+TXEY2 XXXg== X-Gm-Message-State: ALoCoQlzBVGBrrkvpPEoEF41895xJAZe3zBIxKNhrbEWqZP8Lakih+MjYkbLGZIFjHTEuWxwEie6ZVMBEeUtYZEHPgMPYGXaLJ22vc44a0mCjMpoN9wdSOA= MIME-Version: 1.0 X-Received: by 10.60.155.35 with SMTP id vt3mr2938259oeb.32.1397588592244; Tue, 15 Apr 2014 12:03:12 -0700 (PDT) Received: by 10.182.24.169 with HTTP; Tue, 15 Apr 2014 12:03:12 -0700 (PDT) In-Reply-To: References: Date: Tue, 15 Apr 2014 12:03:12 -0700 Message-ID: Subject: Re: Find the task and it's datanode which is taking the most time in a cluster From: Abdelrahman Shettia To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bd6b61a9551cc04f719739e X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd6b61a9551cc04f719739e Content-Type: text/plain; charset=US-ASCII Hi Shashi, I am assuming that you are running hadoop 1.x. There is an option to see the failed tasks on the Job tracker UI. Please replace the jobtracker host with the actual host and click on the following link and look for the task failure. http://[jobtrackerhost]:50030/machines.jsp?type=active Thanks -Rahman On Tue, Apr 15, 2014 at 11:11 AM, Shashidhar Rao wrote: > Hi, > > Can somebody please help me how to find the task and the datanode in a > large cluster which has failed or which is taking the most time to execute > considering thousands of mappers and reducers are running. > > Regards > Shashi > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --047d7bd6b61a9551cc04f719739e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Shashi,

I am assuming that you are r= unning hadoop 1.x. There is an option to see the failed tasks on the Job tr= acker UI. Please replace the jobtracker host =A0with the actual host and cl= ick on the following link and look for the task failure. =A0

http://[jobtrackerhost]:50030/machines.jsp?type=3Dactiv= e


Thanks
-Rahman


On Tue= , Apr 15, 2014 at 11:11 AM, Shashidhar Rao <raoshashidhar123@gmai= l.com> wrote:
Hi,

Can = somebody please help me how to find the task and the datanode in a large cl= uster which has failed or which is taking the most time to execute consider= ing thousands of mappers and reducers are running.

Regards
Shashi


CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --047d7bd6b61a9551cc04f719739e--