hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Wed, 15 Apr 2009 21:36:14 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12699401#action_12699401
] 

Allen Wittenauer commented on HADOOP-5670:
------------------------------------------

The amount of churn in a configuration file that only points to where to read the real configuration
data is significantly lower than changes in Hadoop's configuration in my experience.   For
example, our system level ldap.conf has changed maybe three times in 1 year, and most of those
were growing pains of a new infrastructure/data center. I have lost track of how many times
we have needed to change and bounce the jobtracker ACLs in the past *week*.

Additionally, HTTP, LDAP, etc, have real, proven HA solutions.  They are much less likely
to go down than the Hadoop grids they would be supporting....

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
>
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,
whatever.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message