hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Capriolo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Tue, 11 May 2010 22:46:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12866377#action_12866377

Edward Capriolo commented on HADOOP-5670:

I have been really intested in this ticket for a while. I think we can go in circles for a
long time. No solution will fit everyonones needs.

The best general solution in my optionion is LDAP. why?

* if you have an argument against ldap but are making a case for zookeeper every argument
you make against ldap could be made against zookeeper
* LDAP is easy to scale single master+thousands of slaves or multi master configurations
* LDAP is the defacto standard for the configuration of network servers
* JAVA provides built in directory clients
* Current hadoop configuration with overrides per host can be easily accomplished with LDAP
* yes nodes will have to bootstrap with a hostname or lookup a default host
* people that dont want to run LDAP for hadoop probably will not want to run alternative XYZ
either. For those people their are configuration files.

If someone seconds the 'I like LDAP idea' I will start working on it and submit a patch for

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message