hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-9570) Configuration.addResource() should only parse the new resource
Date Fri, 17 May 2013 17:59:16 GMT
Gopal V created HADOOP-9570:

             Summary: Configuration.addResource() should only parse the new resource
                 Key: HADOOP-9570
                 URL: https://issues.apache.org/jira/browse/HADOOP-9570
             Project: Hadoop Common
          Issue Type: Bug
          Components: conf
         Environment: Ubuntu LXC
            Reporter: Gopal V
            Assignee: Gopal V
            Priority: Minor

Hadoop configuration parsing re-parses all configuration files when a new resource is added
to the configuration object.

This is wasteful and runs through every deprecation check unnecessarily.

JobConf clone = new JobConf(job);

will reparse every file including core-site, hdfs-site etc.

Resource addition can be taken care of cleanly, if the addResourceObject() call applies the
new resource, followed by applying the overlay, without re-parsing any of the older files
already loaded into the hashtable.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message