hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From José Luis Larroque <larroques...@gmail.com>
Subject Re: mapred.job.id is deprecated. Instead, use mapreduce.job.id
Date Sun, 30 Aug 2015 14:51:29 GMT
Thanks for your explanation Varun, i didn't realize that.

I will inform this into the GIRAPH Jira, Ted, thanks for your recomendation.

Bye!
Jose

2015-08-29 15:33 GMT-03:00 Ted Yu <yuzhihong@gmail.com>:

> A brief search involving mapred.job.id among the GIRAPH JIRAs doesn't
> result in any hit.
>
> Jose:
> Maybe you can log one.
>
> Cheers
>
> On Sat, Aug 29, 2015 at 11:21 AM, Varun Saxena <vsaxena.varun@gmail.com>
> wrote:
>
>> Hi Jose,
>>
>> I guess you are running Giraph job.
>> This config is being programmatically set by GiraphYarnClient class(refer
>> to
>> http://grepcode.com/file/repo1.maven.org/maven2/org.apache.giraph/giraph-core/1.1.0/org/apache/giraph/yarn/GiraphYarnClient.java
>> ).
>> It is not being taken from a XML config file.
>>
>> Regards,
>> Varun Saxena.
>>
>> On Sat, Aug 29, 2015 at 9:15 PM, José Luis Larroque <
>> larroquester@gmail.com> wrote:
>>
>>> I'm using hadoop 2.4.0. Here are the logs (this message doesn't appear
>>> at cluster initialization, it appears when a new job is invocated, my
>>> mistake):
>>>
>>> SLF4J: Class path contains multiple SLF4J bindings.
>>> SLF4J: Found binding in
>>> [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/usr/local/hadoop/share/hadoop/yarn/lib/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/giraph-examples-1.1.0-for-hadoop-2.4.0-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/procesamiento_grafo_wikiquote.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: Found binding in
>>> [jar:file:/usr/local/hadoop/share/hadoop/mapreduce/wordcount_mio.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>>> explanation.
>>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
>>> 15/08/29 12:42:17 WARN util.NativeCodeLoader: Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge input format
>>> specified. Ensure your InputFormat does not require one.
>>> 15/08/29 12:42:18 INFO utils.ConfigurationUtils: No edge output format
>>> specified. Ensure your OutputFormat does not require one.
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Final output path is:
>>> hdfs://hdnode01:54310/user/hduser/output/caminosNavegacionales1
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Running Client
>>> 15/08/29 12:42:18 INFO client.RMProxy: Connecting to ResourceManager at
>>> hdnode01/192.168.0.10:8050
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
>>> for, nodeId=hadoop100:51831, nodeAddress hadoop100:8042, nodeRackName
>>> /default-rack, nodeNumContainers 0
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Got node report from ASM
>>> for, nodeId=hadoop101:40809, nodeAddress hadoop101:8042, nodeRackName
>>> /default-rack, nodeNumContainers 0
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Obtained new Application
>>> ID: application_1440862856801_0001
>>> *15/08/29 12:42:18 INFO Configuration.deprecation: mapred.job.id
>>> <http://mapred.job.id> is deprecated. Instead, use mapreduce.job.id
>>> <http://mapreduce.job.id>*
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Set the environment for
>>> the application master
>>> 15/08/29 12:42:18 INFO yarn.GiraphYarnClient: Environment for AM
>>> :{CLASSPATH=${CLASSPATH}:./*:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/share/hadoop/common/*:$HADOOP_COMMON_HOME/share/hadoop/common/lib/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/*:$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*:$HADOOP_YARN_HOME/share/hadoop/yarn/*:$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*}
>>> ...
>>>
>>> Cheers!
>>>
>>>
>>> 2015-08-29 12:26 GMT-03:00 Ted Yu <yuzhihong@gmail.com>:
>>>
>>>> Please provide a bit more information:
>>>>
>>>> release of hadoop you're using
>>>> snippet of the log showing the error
>>>>
>>>> Normally from Web UI, you can retrieve the complete list of parameters
>>>>
>>>> Cheers
>>>>
>>>> On Sat, Aug 29, 2015 at 8:19 AM, José Luis Larroque <
>>>> larroquester@gmail.com> wrote:
>>>>
>>>>> Hi guys, i was removing some warnings for deprecated properties from
>>>>> my hadoop cluster, but i find this interesting warning when my cluster
it's
>>>>> initializing:
>>>>>
>>>>> *mapred.job.id <http://mapred.job.id> is deprecated. Instead, use
>>>>> mapreduce.job.id <http://mapreduce.job.id>*
>>>>>
>>>>> But i can't find this property (*mapred.job.id <http://mapred.job.id>*)
>>>>> in any of my configuration xml files for replacing it. I'm missing
>>>>> something here ? This is a minor bug ?
>>>>>
>>>>> Thanks for reading!
>>>>>
>>>>> Jose
>>>>>
>>>>
>>>>
>>>
>>
>

Mime
View raw message