hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Fri, 17 Apr 2009 15:30:14 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12700209#action_12700209

Tom White commented on HADOOP-5670:

ZK uses Java properties files, so it has no dependencies on Hadoop Core configuration.

The bootstrapping problem is that FileSystem relies on a Configuration object having loaded
its resources. So to get a Configuration to load from a FileSystem won't work, the way things
stand (see Configuration#loadResource). (It's possible that the reason for this code has gone
away, or at least lessened, following the recent split of configurations into core, hdfs and
mapred - it might be possible to bootstrap from the core config.) There's no inherent reason,
though, why a Configuration couldn't load its resources from HDFS or a ZK-backed FileSystem.
We just need to avoid a system loading resources from itself.

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message