hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward Capriolo (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Wed, 12 May 2010 14:26:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12866582#action_12866582

Edward Capriolo commented on HADOOP-5670:

Jeff the implementation I want to go for was described above:

I suppose if all we wish is to replace basically the -D options passed into hadoop, then I
am very openminded to a ldap based scheme as a plugin. I would be very happy if it included
some scoping so that configuration could be provided on a intra cluster, inter cluster, host
,user or job level. Guidelines should be provided as how not to disrupt existing ldap users.

And meet this requirement:

I think we don't need to debate hard on ldap versus zookeeper versus etc on this specific
issue. I assume that we would have the abstraction here so that folks can try out different
systems - ldap, zookeeper etc. and can configure one as per their environment needs.

Also I wanted to add that since the new hadoop security is kerberos. Kerberos is normally
backended by LDAP, so a good point of users will have an ldap server at their disposal.

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message