hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Thomas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6634) inotify in HDFS
Date Thu, 10 Jul 2014 23:57:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058136#comment-14058136
] 

James Thomas commented on HDFS-6634:
------------------------------------

Initially we will expose the entire stream to superusers only. As noted in the design doc,
the load on the NN shouldn't be terribly high since the edits simply need to be sent over
the wire and additional processing (like converting to ProtoBuf'ed form) can be done on the
clients. In addition, as Andrew mentioned above, we can run this system as a separate, reduced-functionality
NN (much like the Standby NN) if the load on the primary NN is too high.

> inotify in HDFS
> ---------------
>
>                 Key: HDFS-6634
>                 URL: https://issues.apache.org/jira/browse/HDFS-6634
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client, namenode, qjm
>            Reporter: James Thomas
>            Assignee: James Thomas
>         Attachments: inotify-intro.2.pdf, inotify-intro.pdf
>
>
> Design a mechanism for applications like search engines to access the HDFS edit stream.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message