hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Patrick Hunt (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5670) Hadoop configurations should be read from a distributed system
Date Tue, 06 Apr 2010 18:29:33 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854108#action_12854108

Patrick Hunt commented on HADOOP-5670:

bq. would be interesting to know how well used the security components of ZK are

ZK has plugable auth with acls on the znodes. Yahoo uses this internally for multi-tenant
ZK clusters, the auth
in this case is Yahoo specific implementation (uses certificates). We have met with the Yahoo
Hadoop Security
team, we don't have a kerberos plugin for ZK auth yet but we have discussed it.

bq. you can run Hadoop without using ZK

that's true for MR/HDFS today, it may not be so in future.

HBase requires ZK today, so if you're using HBase you're already using ZK. ;-)

bq. LDAP is a well understood technology by most IT departments and ZK is not

I agree with this, in general most IT departments are going to be much more familiar with
technologies such
as LDAP, MySQL, Exchange, etc... that have been around for a while. This is a big plus. ZK
is still very new
relative to these mature technologies. (although the same could be said for Hadoop itself).

> Hadoop configurations should be read from a distributed system
> --------------------------------------------------------------
>                 Key: HADOOP-5670
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5670
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: conf
>            Reporter: Allen Wittenauer
> Rather than distributing the hadoop configuration files to every data node, compute node,
etc, Hadoop should be able to read configuration information (dynamically!) from LDAP, ZooKeeper,

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message