hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Surendra Singh Lilhore (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service
Date Thu, 07 Jul 2016 08:48:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365824#comment-15365824

Surendra Singh Lilhore commented on HDFS-8940:

 Hi All,

 Why we will not use JournalNode as a {{Inotify Service}} instead of adding one new service
 *One suggestion from my side :*
 We can use JournalNode as {{Inotify Service}}. In HDFS cluster we can install multiple Journal
Node, in that we can choose one Journal Node for Inotify service. 

 1. We can configure one JounalNode as Inotify service. 


2. Client will connect with this JournalNode and pull the events. If client is connecting
with some other JournalNode which is not supporting Inotify, then it will throw {{NotSupportInotifyException}}.

3. SNN will not read edits from the InotifyService Journal Node. For this we can configure
{{dfs.namenode.shared.edits.dir}} like this in NN.
Here {{\[Inotify\]}} indicate it is only for write not for read, so SNN will not try to read
edits from this node.

> Support for large-scale multi-tenant inotify service
> ----------------------------------------------------
>                 Key: HDFS-8940
>                 URL: https://issues.apache.org/jira/browse/HDFS-8940
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>         Attachments: Large-Scale-Multi-Tenant-Inotify-Service.pdf
> HDFS-6634 provides the core inotify functionality. We would like to extend that to provide
a large-scale service that ten of thousands of clients can subscribe to.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message