hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Prakash (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-2417) Warnings about attempt to override final parameter while getting delegation token
Date Tue, 08 Nov 2011 22:33:51 GMT

     [ https://issues.apache.org/jira/browse/HDFS-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravi Prakash updated HDFS-2417:
-------------------------------

    Resolution: Duplicate
        Status: Resolved  (was: Patch Available)

Attached the patch for branch-0.20-security to HADOOP-7664
                
> Warnings about attempt to override final parameter while getting delegation token
> ---------------------------------------------------------------------------------
>
>                 Key: HDFS-2417
>                 URL: https://issues.apache.org/jira/browse/HDFS-2417
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: name-node
>    Affects Versions: 0.20.205.0
>            Reporter: Rajit Saha
>            Assignee: Ravi Prakash
>         Attachments: HDFS-2417.patch
>
>
> I am seeing whenever I run any Mapreduce job and its trying to acquire delegation from
NN, In JT log following warnings coming about "a attempt to override final parameter:"
> The log snippet in JT log
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
> mapred.job.reuse.jvm.num.tasks;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
mapred.system.dir;
>  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
> hadoop.job.history.user.location;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
mapred.local.dir; 
> Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
m
> apred.job.tracker.http.address;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
d
> fs.data.dir;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
d
> fs.http.address;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
m
> apreduce.admin.map.child.java.opts;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
> mapreduce.history.server.http.address;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
m
> apreduce.history.server.embedded;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
m
> apreduce.jobtracker.split.metainfo.maxsize;  Ignoring.2011-10-07 20:29:19,096 WARN
> org.apache.hadoop.conf.Configuration: /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a
attempt to
> override final parameter: m
> apreduce.admin.reduce.child.java.opts;  Ignoring.2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
h
> adoop.tmp.dir;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
> mapred.jobtracker.maxtasks.per.job;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
> mapred.job.tracker;  Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
dfs.name.dir; 
> Ignoring.
> 2011-10-07 20:29:19,096 WARN org.apache.hadoop.conf.Configuration:
> /tmp/mapred-local/jobTracker/job_201110072015_0005.xml:a attempt to override final parameter:
m
> apred.temp.dir;  Ignoring.2011-10-07 20:29:19,103 INFO
> org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal: registering token
for renewal for service
> =<NN IP>:50470 and jobID 
> = job_201110072015_0005
> 2011-10-07 20:29:19,103 INFO org.apache.hadoop.mapreduce.security.token.DelegationTokenRenewal:
registering token for
> renewal for service =<NN IP>:8020 and jobID = job_201110072015_0005
> The STDOUT of distcp job when these warnings logged into JT log
> ----------------------------------------------------------------
> $hadoop  distcp hftp://<NN>:50070/tmp/inp out
> 11/10/07 20:29:17 INFO tools.DistCp:
> srcPaths=[hftp://<NN>:50070/tmp/inp]
> 11/10/07 20:29:17 INFO tools.DistCp: destPath=out
> 11/10/07 20:29:18 INFO security.TokenCache: Got dt for
> hftp://<NN>:50070/tmp/inp;uri=<NN IP>:50470;t.service=<NN IP>:50470
> 11/10/07 20:29:18 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 7 for <user>
on <NN IP>:8020
> 11/10/07 20:29:18 INFO security.TokenCache: Got dt for
> 1318019341/as;uri=<NN IP>:8020;t.service=<NN IP>:8020
> ..
> ..
> If this is not critical, it may be unnecessary noise in log

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message