hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5194) Avoid adding yarn-site to all Configuration instances created by the JVM
Date Mon, 06 Jun 2016 18:14:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15316909#comment-15316909

Siddharth Seth commented on YARN-5194:

This will likely break a bunch of things - hence targeted at 3.0. Could you please elaborate
on HDFS getConf ?
If there's enough interest to reduce the size of config objects in memory / serialized size
- this can be taken up for a 3.x release.

> Avoid adding yarn-site to all Configuration instances created by the JVM
> ------------------------------------------------------------------------
>                 Key: YARN-5194
>                 URL: https://issues.apache.org/jira/browse/YARN-5194
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
> {code}
> static {
>     addDeprecatedKeys();
>     Configuration.addDefaultResource(YARN_DEFAULT_CONFIGURATION_FILE);
>     Configuration.addDefaultResource(YARN_SITE_CONFIGURATION_FILE);
>   }
> {code}
> This puts the contents of yarn-default and yarn-site into every configuration instance
created in the VM after YarnConfiguration has been initialized.
> This should be changed to a local addResource for the specific YarnConfiguration instance,
instead of polluting every Configuration instance.
> Incompatible change. Have set the target version to 3.x. 
> The same applies to HdfsConfiguration (hdfs-site.xml), and Configuration (core-site.xml
> core-site may be worth including everywhere, however it would be better to expect users
to explicitly add the relevant resources.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message