Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6E546186F2 for ; Sun, 30 Aug 2015 20:28:07 +0000 (UTC) Received: (qmail 58618 invoked by uid 500); 30 Aug 2015 14:52:02 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 58496 invoked by uid 500); 30 Aug 2015 14:52:02 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 58486 invoked by uid 99); 30 Aug 2015 14:52:02 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 30 Aug 2015 14:52:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id AE8D5C2096 for ; Sun, 30 Aug 2015 14:52:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Hp41bjqaEhtf for ; Sun, 30 Aug 2015 14:51:50 +0000 (UTC) Received: from mail-ob0-f196.google.com (mail-ob0-f196.google.com [209.85.214.196]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id BB75125783 for ; Sun, 30 Aug 2015 14:51:49 +0000 (UTC) Received: by obcji4 with SMTP id ji4so365344obc.3 for ; Sun, 30 Aug 2015 07:51:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=I2s4GRHRJWWeSXcLTnFzkGU0f480FigVp01NhWSK+wk=; b=kyEPgpIJCDHLARLQ+yYY6xP5eB5oZwuloC8cMQguiAk3E8CNov+DJR/u/ia2ueIvIm +Zh1xHgav8whCP4XoftTcSpxK2/ciVPYMc2SP7GC7aqwwwqKbeAAcjhtZOhJ8lZSmIR2 thmlUbBnaFDbwA/lCYYoaQlVNSF43C5wc1Qe+ZHOskmNfLXHHhpwdhB/Mo8y+sIrGzvI /AdxJus4wW4CGHQJnP3/tlOeTO5KA2PiARc6QmdqRIBfHh0uQ4sgO2J6qFlKQtNVoEeA 7D2My+/zDOOo/Rbgija0uHTtNmBZlAy2dtDrju0OWDjCyjvC7mQDmw7KI9LqOkpaPf+Q D0GQ== X-Received: by 10.182.29.39 with SMTP id g7mr11819559obh.15.1440946308491; Sun, 30 Aug 2015 07:51:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.44.149 with HTTP; Sun, 30 Aug 2015 07:51:29 -0700 (PDT) In-Reply-To: References: From: =?UTF-8?Q?Jos=C3=A9_Luis_Larroque?= Date: Sun, 30 Aug 2015 11:51:29 -0300 Message-ID: Subject: Re: mapred.job.id is deprecated. Instead, use mapreduce.job.id To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c20130dbb09d051e887421 --001a11c20130dbb09d051e887421 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks for your explanation Varun, i didn't realize that. I will inform this into the GIRAPH Jira, Ted, thanks for your recomendation= . Bye! Jose 2015-08-29 15:33 GMT-03:00 Ted Yu : > A brief search involving mapred.job.id among the GIRAPH JIRAs doesn't > result in any hit. > > Jose: > Maybe you can log one. > > Cheers > > On Sat, Aug 29, 2015 at 11:21 AM, Varun Saxena > wrote: > >> Hi Jose, >> >> I guess you are running Giraph job. >> This config is being programmatically set by GiraphYarnClient class(refe= r >> to >> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph= -core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java >> ). >> It is not being taken from a XML config file. >> >> Regards, >> Varun Saxena. >> >> On Sat, Aug 29, 2015 at 9:15 PM, Jos=C3=A9 Luis Larroque < >> larroquester@gmail.com> wrote: >> >>> I'm using hadoop 2.4.0. Here are the logs (this message doesn't appear >>> at cluster initialization, it appears when a new job is invocated, my >>> mistake): >>> >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5= .jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-examples-1.1.0= -for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBin= der.class] >>> SLF4J: Found binding in >>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.= 0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBi= nder.class] >>> SLF4J: Found binding in >>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_grafo_= wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mio.jar!/o= rg/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> 15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load >>> native-hadoop library for your platform... using builtin-java classes w= here >>> applicable >>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format >>> specified. Ensure your InputFormat does not require one. >>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format >>> specified. Ensure your OutputFormat does not require one. >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is: >>> hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1 >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client >>> 15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at >>> hdnode01/192.168.0.10:8050 >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM >>> for, nodeId=3Dhadoop100:51831, nodeAddress hadoop100:8042, nodeRackName >>> /default-rack, nodeNumContainers 0 >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM >>> for, nodeId=3Dhadoop101:40809, nodeAddress hadoop101:8042, nodeRackName >>> /default-rack, nodeNumContainers 0 >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application >>> ID: application_1440862856801_0001 >>> *15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id >>> is deprecated. Instead, use mapreduce.job.id >>> * >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for >>> the application master >>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM >>> :{CLASSPATH=3D${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/sha= re/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HD= FS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADO= OP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:= $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hado= op/mapreduce/lib/*} >>> ... >>> >>> Cheers! >>> >>> >>> 2015-08-29 12:26 GMT-03:00 Ted Yu : >>> >>>> Please provide a bit more information: >>>> >>>> release of hadoop you're using >>>> snippet of the log showing the error >>>> >>>> Normally from Web UI, you can retrieve the complete list of parameters >>>> >>>> Cheers >>>> >>>> On Sat, Aug 29, 2015 at 8:19 AM, Jos=C3=A9 Luis Larroque < >>>> larroquester@gmail.com> wrote: >>>> >>>>> Hi guys, i was removing some warnings for deprecated properties from >>>>> my hadoop cluster, but i find this interesting warning when my cluste= r it's >>>>> initializing: >>>>> >>>>> *mapred.job.id is deprecated. Instead, use >>>>> mapreduce.job.id * >>>>> >>>>> But i can't find this property (*mapred.job.id = *) >>>>> in any of my configuration xml files for replacing it. I'm missing >>>>> something here ? This is a minor bug ? >>>>> >>>>> Thanks for reading! >>>>> >>>>> Jose >>>>> >>>> >>>> >>> >> > --001a11c20130dbb09d051e887421 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks for your explanation Varun, i didn&#= 39;t realize that.

I will inform this into the GIRAPH Jira, Te= d, thanks for your recomendation.

Bye!
Jose
=

2015-08-29 15:33 = GMT-03:00 Ted Yu <yuzhihong@gmail.com>:
A brief search involving mapred.job.id=C2=A0among the=C2=A0GIR= APH JIRAs doesn't result in any hit.

Jose:
Maybe you can log one.

Cheers

On Sat, Aug 29, 2015 at 11:21 AM, Varun Saxena <v= saxena.varun@gmail.com> wrote:
Hi Jose,

I guess you are running Gi= raph job.
It is not being taken from a XML config file.

Regards,
Varun Saxena.

On Sat, Aug 29, = 2015 at 9:15 PM, Jos=C3=A9 Luis Larroque <larroquester@gmail.com&= gt; wrote:
I= 'm using hadoop 2.4.0. Here are the logs (this message doesn't appe= ar at cluster initialization, it appears when a new job is invocated, my mi= stake):

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J= : Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4= j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Fou= nd binding in [jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-exam= ples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/Stati= cLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hadoop= /share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dep= endencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found bin= ding in [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_gr= afo_wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found= binding in [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mi= o.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://w= ww.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J:= Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/08/29 = 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop library f= or your platform... using builtin-java classes where applicable
15/08/29= 12:42:18 INFO utils.ConfigurationUtils: No edge input format specified. En= sure your InputFormat does not require one.
15/08/29 12:42:18 INFO utils= .ConfigurationUtils: No edge output format specified. Ensure your OutputFor= mat does not require one.
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: = Final output path is: hdfs://hdnode01:54310/user/hduser/output/caminosNaveg= acionales1
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client<= br>15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at = hdnode01/192.168.0.1= 0:8050
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report= from ASM for, nodeId=3Dhadoop100:51831, nodeAddress hadoop100:8042, nodeRa= ckName /default-rack, nodeNumContainers 0
15/08/29 12:42:18 INFO yarn.Gi= raphYarnClient: Got node report from ASM for, nodeId=3Dhadoop101:40809, nod= eAddress hadoop101:8042, nodeRackName /default-rack, nodeNumContainers 015/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID:= application_1440862856801_0001
15/08/29 12:42:18 INFO Configuration.= deprecation: mapred.job.= id is deprecated. Instead, use mapreduce.job.id
15/08/29 12:42:18 INFO yarn.Girap= hYarnClient: Set the environment for the application master
15/08/29 12:= 42:18 INFO yarn.GiraphYarnClient: Environment for AM :{CLASSPATH=3D${CLASSP= ATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP= _COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/= *:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/= yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/= hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
...=

Cheers!


2015-08-29 12:26 GMT-03:00 Ted Yu = <yuzhihong@gmai= l.com>:
Pl= ease provide a bit more information:

release of hadoop y= ou're using
snippet of the log showing the error
Normally from Web UI, you can retrieve the complete list of pa= rameters

Cheers

On Sat, Aug 29, 2015 at 8:19 A= M, Jos=C3=A9 Luis Larroque <larroquester@gmail.com> wro= te:
Hi gu= ys, i was removing some warnings for deprecated properties from my hadoop c= luster, but i find this interesting warning when my cluster it's initia= lizing:

mapred= .job.id is deprecated. Instead, use mapreduce.job.id

But i can't fi= nd this property (map= red.job.id) in any of my configuration xml files for replacing it. = I'm missing something here ? This is a minor bug ?

Thanks = for reading!

Jose





--001a11c20130dbb09d051e887421--