hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: mapred.job.id is deprecated. Instead, use mapreduce.job.id
Date Sat, 29 Aug 2015 18:33:00 GMT
A brief search involving mapred.job.id among the GIRAPH JIRAs doesn't
result in any hit.

Jose:
Maybe you can log one.

Cheers

On Sat, Aug 29, 2015 at 11:21 AM, Varun Saxena <vsaxena.varun@gmail.com>
wrote:

> Hi Jose,
>
> I guess you are running Giraph job.
> This config is being programmatically set by GiraphYarnClient class(refer
> to
> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java
> ).
> It is not being taken from a XML config file.
>
> Regards,
> Varun Saxena.
>
> On Sat, Aug 29, 2015 at 9:15 PM, José Luis Larroque <
> larroquester@gmail.com> wrote:
>
>> I'm using hadoop 2.4.0. Here are the logs (this message doesn't appear at
>> cluster initialization, it appears when a new job is invocated, my mistake):
>>
>> SLF4J: Class path contains multiple SLF4J bindings.
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_grafo_wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: Found binding in
>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mio.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>> explanation.
>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>> 15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format
>> specified. Ensure your InputFormat does not require one.
>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format
>> specified. Ensure your OutputFormat does not require one.
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is:
>> hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
>> 15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at
>> hdnode01/192.168.0.10:8050
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
>> for, nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName
>> /default-rack, nodeNumContainers 0
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
>> for, nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName
>> /default-rack, nodeNumContainers 0
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application
>> ID: application_1440862856801_0001
>> *15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id
>> <http://mapred.job.id> is deprecated. Instead, use mapreduce.job.id
>> <http://mapreduce.job.id>*
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for the
>> application master
>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM
>> :{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
>> ...
>>
>> Cheers!
>>
>>
>> 2015-08-29 12:26 GMT-03:00 Ted Yu <yuzhihong@gmail.com>:
>>
>>> Please provide a bit more information:
>>>
>>> release of hadoop you're using
>>> snippet of the log showing the error
>>>
>>> Normally from Web UI, you can retrieve the complete list of parameters
>>>
>>> Cheers
>>>
>>> On Sat, Aug 29, 2015 at 8:19 AM, José Luis Larroque <
>>> larroquester@gmail.com> wrote:
>>>
>>>> Hi guys, i was removing some warnings for deprecated properties from my
>>>> hadoop cluster, but i find this interesting warning when my cluster it's
>>>> initializing:
>>>>
>>>> *mapred.job.id <http://mapred.job.id> is deprecated. Instead, use
>>>> mapreduce.job.id <http://mapreduce.job.id>*
>>>>
>>>> But i can't find this property (*mapred.job.id <http://mapred.job.id>*)
>>>> in any of my configuration xml files for replacing it. I'm missing
>>>> something here ? This is a minor bug ?
>>>>
>>>> Thanks for reading!
>>>>
>>>> Jose
>>>>
>>>
>>>
>>
>

Mime
View raw message