hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Varun Saxena <vsaxena.va...@gmail.com>
Subject Re: mapred.job.id is deprecated. Instead, use mapreduce.job.id
Date Sat, 29 Aug 2015 18:21:24 GMT
Hi Jose,

I guess you are running Giraph job.
This config is being programmatically set by GiraphYarnClient class(refer
to
http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java
).
It is not being taken from a XML config file.

Regards,
Varun Saxena.

On Sat, Aug 29, 2015 at 9:15 PM, José Luis Larroque <larroquester@gmail.com>
wrote:

> I'm using hadoop 2.4.0. Here are the logs (this message doesn't appear at
> cluster initialization, it appears when a new job is invocated, my mistake):
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_grafo_wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mio.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format
> specified. Ensure your InputFormat does not require one.
> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format
> specified. Ensure your OutputFormat does not require one.
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is:
> hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
> 15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at
> hdnode01/192.168.0.10:8050
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
> for, nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName
> /default-rack, nodeNumContainers 0
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
> for, nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName
> /default-rack, nodeNumContainers 0
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application ID:
> application_1440862856801_0001
> *15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id
> <http://mapred.job.id> is deprecated. Instead, use mapreduce.job.id
> <http://mapreduce.job.id>*
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the
> application master
> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM
> :{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
> ...
>
> Cheers!
>
>
> 2015-08-29 12:26 GMT-03:00 Ted Yu <yuzhihong@gmail.com>:
>
>> Please provide a bit more information:
>>
>> release of hadoop you're using
>> snippet of the log showing the error
>>
>> Normally from Web UI, you can retrieve the complete list of parameters
>>
>> Cheers
>>
>> On Sat, Aug 29, 2015 at 8:19 AM, José Luis Larroque <
>> larroquester@gmail.com> wrote:
>>
>>> Hi guys, i was removing some warnings for deprecated properties from my
>>> hadoop cluster, but i find this interesting warning when my cluster it's
>>> initializing:
>>>
>>> *mapred.job.id <http://mapred.job.id> is deprecated. Instead, use
>>> mapreduce.job.id <http://mapreduce.job.id>*
>>>
>>> But i can't find this property (*mapred.job.id <http://mapred.job.id>*)
>>> in any of my configuration xml files for replacing it. I'm missing
>>> something here ? This is a minor bug ?
>>>
>>> Thanks for reading!
>>>
>>> Jose
>>>
>>
>>
>

Mime
View raw message