Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B629D10070 for ; Thu, 3 Apr 2014 07:26:20 +0000 (UTC) Received: (qmail 665 invoked by uid 500); 3 Apr 2014 07:26:13 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 99890 invoked by uid 500); 3 Apr 2014 07:26:10 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 99881 invoked by uid 99); 3 Apr 2014 07:26:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Apr 2014 07:26:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of azuryyyu@gmail.com designates 209.85.216.175 as permitted sender) Received: from [209.85.216.175] (HELO mail-qc0-f175.google.com) (209.85.216.175) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 03 Apr 2014 07:26:02 +0000 Received: by mail-qc0-f175.google.com with SMTP id e16so1435247qcx.34 for ; Thu, 03 Apr 2014 00:25:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=T8viIupldC9Lg7yW3eWm+mGDfUV16qEFeLRagCRxfJo=; b=X7Sip5L/3uZNlo0dV330nVrBz/grObYWzV7timneshG459hvHlJ6RvxUT4ZM83oo1I tZ5+xQlj8+2qIehHPXaXYHyzUy+RLlHiAhXZdn0s1uPu2elqfWc0Tzvc097sgqhbn+Zr B/XoWpXgNkQUl9JpsLTka2Y4SmduTmbDPOWi0Qb3BCsFXsvalEsgs0Ik7VIO+VtWAQU1 6QKudk1cTfE5cxzspwymBOlVxIrxFD/iH2mLCVKNjSEm6cTYpcUi6oVQU2ElDcLsKvG9 yubgCSA9ADAdGd7qJjIhm+Bw4N/3xWW0YU3fAcg2vUWjTC9ib27GMsxrJaozKeF8mAaX 1xmA== MIME-Version: 1.0 X-Received: by 10.140.38.37 with SMTP id s34mr5469889qgs.88.1396509940729; Thu, 03 Apr 2014 00:25:40 -0700 (PDT) Received: by 10.140.44.53 with HTTP; Thu, 3 Apr 2014 00:25:40 -0700 (PDT) In-Reply-To: References: Date: Thu, 3 Apr 2014 15:25:40 +0800 Message-ID: Subject: Re: Container states trantition questions From: Azuryy Yu To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a11c11c74f14cfb04f61e4e24 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c11c74f14cfb04f61e4e24 Content-Type: text/plain; charset=ISO-8859-1 Hi Zhijie, Yes, I opened debug level, and looked through RM, AM, container's logs, container always receive SIGTERM(15) after transition to FINISHED, webUI just shows the diagnostics message. Thanks Zhijie. On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen wrote: > It should be normal. If you can check the diagnostics of the container, it > is likely that you will see "Container killed by the ApplicationMaster." MR > AM will stop the container when a task is finished. > > Thanks, > Zhijie > > > On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO wrote: > >> same for me. all mapper ends with 143. >> >> I've no idea what it means >> >> >> 2014-04-03 8:45 GMT+08:00 Azuryy Yu : >> >> Hi, >>> >>> Does it normal for each container end with TERMINATED(143) ? >>> The whole MR job is successful, but all containers in the map phase end >>> with 143. >>> >>> There are no any useful logs in the NM, AM, Container logs. >>> >>> Another minor question: >>> There are only WARN logs in the stderr: >>> log4j:WARN No appenders could be found for logger >>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl). >>> log4j:WARN Please initialize the log4j system properly. >>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor more info. >>> It seems cannot find log4j.propertites, but I've configured: >>> >>> mapreduce.application.classpath >>> >>> $HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/* >>> >>> >>> yarn.application.classpath >>> >>> $HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/* >>> >>> >>> Appreciate for any inputs. >>> >>> >>> >>> >>> >>> >>> >> > > > -- > Zhijie Shen > Hortonworks Inc. > http://hortonworks.com/ > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. --001a11c11c74f14cfb04f61e4e24 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Zhijie,
Yes, I opened debug level, and = looked through RM, AM, container's logs,=A0 container always receive SI= GTERM(15) after transition to FINISHED,=A0 webUI just shows the diagnostics= message.
=A0
Thanks Zhijie.

On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen= <zshen@hortonworks.com> wrote:
It should be normal. If you= can check the diagnostics of the container, it is likely that you will see= "Container killed by the ApplicationMaster." MR AM will stop the= container when a task is finished.

Thanks,
Zhijie


On Wed, Apr 2,= 2014 at 7:22 PM, Fengyun RAO <raofengyun@gmail.com> wrot= e:
same for me. all mapper ends with 143.=A0=

I've no idea what it means


2014-04-03 8:45 GMT+08:00 Azuryy Yu <a= zuryyyu@gmail.com>:

Hi,
=A0
Does it normal for each container end with TERM= INATED(143) ?
The whole MR job is successful, but all containers in the map phase en= d with 143.
=A0
There are no any useful logs in the NM, AM, Container lo= gs.
=A0
Another minor question:
There are only WARN lo= gs in the stderr:
log4j:WARN No appenders could be found for logg= er (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
log4j:WARN Pleas= e initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconf= ig for more info.
It seems cannot find log4j.propertites,= but I've configured:
<property>
=A0 <name>mapreduce.application.classpath<= ;/name>
=A0=A0<value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HO= ME/*,$HADOOP_MAPRED_HOME/lib/*</value>
</property>
<property>
=A0=A0=A0<name>yarn.application.classpath</name>=A0=A0=A0
=A0=A0<value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HA= DOOP_COMMON_HOME/lib/*</value>
</property>
=A0
Appreciate for any inputs.
=A0
=A0
=A0
=A0
=A0





--
Zhijie Shen
Hortonworks = Inc.

CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u.

--001a11c11c74f14cfb04f61e4e24--