hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service
Date Thu, 07 Jul 2016 23:23:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366960#comment-15366960

Kai Zheng commented on HDFS-8940:

Hi [~mingma],

Could you help clarify if it works or not, in the way I said above that your Zookeeper could
get triggered by Kafka instead of HDFS directly? Or simply: HDFS->Kafka->Zookeeper,
instead of HDFS->Zookeeper. 

I'm thinking that having a Kafka expose all the NameNode activities allowing all kinds of
possible consumers may best align all the requirements like raised here. My side are interested
in this and hope we can sort out an approach so to contribute.

> Support for large-scale multi-tenant inotify service
> ----------------------------------------------------
>                 Key: HDFS-8940
>                 URL: https://issues.apache.org/jira/browse/HDFS-8940
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>         Attachments: Large-Scale-Multi-Tenant-Inotify-Service.pdf
> HDFS-6634 provides the core inotify functionality. We would like to extend that to provide
a large-scale service that ten of thousands of clients can subscribe to.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message