hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Surendra Singh Lilhore (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service
Date Thu, 07 Jul 2016 08:48:11 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365824#comment-15365824
] 

Surendra Singh Lilhore commented on HDFS-8940:
----------------------------------------------

 Hi All,

 Why we will not use JournalNode as a {{Inotify Service}} instead of adding one new service
?
 
 *One suggestion from my side :*
 
 We can use JournalNode as {{Inotify Service}}. In HDFS cluster we can install multiple Journal
Node, in that we can choose one Journal Node for Inotify service. 

 1. We can configure one JounalNode as Inotify service. 

{noformat}
 <property>
    <name>dfs.inotify.service</name>
    <value>true</value>
 </property>
{noformat}

2. Client will connect with this JournalNode and pull the events. If client is connecting
with some other JournalNode which is not supporting Inotify, then it will throw {{NotSupportInotifyException}}.



3. SNN will not read edits from the InotifyService Journal Node. For this we can configure
{{dfs.namenode.shared.edits.dir}} like this in NN.
{noformat}
  <property>
    <name>dfs.namenode.shared.edits.dir</name>
    <value>qjournal://x.x.x.x:8485;y.y.y.y:8485;z.z.z.z:8485;[Inotify]s.s.s.s:8485/cluster</value>
  </property>
{noformat}
 
Here {{\[Inotify\]}} indicate it is only for write not for read, so SNN will not try to read
edits from this node.

> Support for large-scale multi-tenant inotify service
> ----------------------------------------------------
>
>                 Key: HDFS-8940
>                 URL: https://issues.apache.org/jira/browse/HDFS-8940
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ming Ma
>         Attachments: Large-Scale-Multi-Tenant-Inotify-Service.pdf
>
>
> HDFS-6634 provides the core inotify functionality. We would like to extend that to provide
a large-scale service that ten of thousands of clients can subscribe to.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message