hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ranjit Mathew (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1418) DFSClient Uses Deprecated "mapred.task.id" Configuration Key Causing Unecessary Warning Messages
Date Wed, 01 Dec 2010 03:24:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965558#action_12965558
] 

Ranjit Mathew commented on HDFS-1418:
-------------------------------------

bq. Actually, the use of MR related configuration parameters (e.g. from upstream project)
looks like a some sort of circular dependency to me. Isn't it?

In this case, it isn't - it's merely used as a distinguishing identifier, if available; a
random number is used otherwise. In
{{src/java/org/apache/hadoop/hdfs/DFSClient.java}} we have:
{code}
256     String taskId = conf.get("mapred.task.id");
257     if (taskId != null) {
258       this.clientName = "DFSClient_" + taskId;
259     } else {
260       this.clientName = "DFSClient_" + r.nextInt();
261     }
{code}

> DFSClient Uses Deprecated "mapred.task.id" Configuration Key Causing Unecessary Warning
Messages
> ------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-1418
>                 URL: https://issues.apache.org/jira/browse/HDFS-1418
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 0.22.0
>            Reporter: Ranjit Mathew
>            Priority: Minor
>             Fix For: 0.22.0
>
>         Attachments: HDFS-1418.patch
>
>
> Every invocation of the "hadoop fs" command leads to an unnecessary warning like the
following:
> {noformat}
> $ $HADOOP_HOME/bin/hadoop fs -ls /
> 10/09/24 15:10:23 WARN conf.Configuration: mapred.task.id is deprecated. Instead, use
mapreduce.task.attempt.id
> {noformat}
> This is easily fixed by updating "src/java/org/apache/hadoop/hdfs/DFSClient.java".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message