hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From José Luis Larroque <larroques...@gmail.com>
Subject Re: mapred.job.id is deprecated. Instead, use mapreduce.job.id
Date Sat, 29 Aug 2015 15:45:35 GMT
I'm using hadoop 2.4.0. Here are the logs (this message doesn't appear at
cluster initialization, it appears when a new job is invocated, my mistake):

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_grafo_wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mio.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format
specified. Ensure your InputFormat does not require one.
15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format
specified. Ensure your OutputFormat does not require one.
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is:
hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at
hdnode01/192.168.0.10:8050
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for,
nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName
/default-rack, nodeNumContainers 0
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM for,
nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName
/default-rack, nodeNumContainers 0
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID:
application_1440862856801_0001
*15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id
<http://mapred.job.id> is deprecated. Instead, use mapreduce.job.id
<http://mapreduce.job.id>*
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the
application master
15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM
:{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
...

Cheers!

2015-08-29 12:26 GMT-03:00 Ted Yu <yuzhihong@gmail.com>:

> Please provide a bit more information:
>
> release of hadoop you're using
> snippet of the log showing the error
>
> Normally from Web UI, you can retrieve the complete list of parameters
>
> Cheers
>
> On Sat, Aug 29, 2015 at 8:19 AM, José Luis Larroque <
> larroquester@gmail.com> wrote:
>
>> Hi guys, i was removing some warnings for deprecated properties from my
>> hadoop cluster, but i find this interesting warning when my cluster it's
>> initializing:
>>
>> *mapred.job.id <http://mapred.job.id> is deprecated. Instead, use
>> mapreduce.job.id <http://mapreduce.job.id>*
>>
>> But i can't find this property (*mapred.job.id <http://mapred.job.id>*)
>> in any of my configuration xml files for replacing it. I'm missing
>> something here ? This is a minor bug ?
>>
>> Thanks for reading!
>>
>> Jose
>>
>
>

Mime
View raw message