hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6634) inotify in HDFS
Date Wed, 01 Apr 2015 23:23:56 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391733#comment-14391733
] 

Colin Patrick McCabe commented on HDFS-6634:
--------------------------------------------

Hi [~bperroud],

HDFS-7446 changed the INotify API to return {{EventBatch}} rather than individual events.
 The reason was because we were unable to resume the event stream from a particular point
in time with the original API.  Basically, this is the same issue you identified.  Unfortunately,
this change was too late for Hadoop 2.6, but it will be in the soon-to-be-released Hadoop
2.7.  Additionally, HDFS-7929 fixed a bug where HDFS upgrades would make some events unavailable
to clients.

> inotify in HDFS
> ---------------
>
>                 Key: HDFS-6634
>                 URL: https://issues.apache.org/jira/browse/HDFS-6634
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client, namenode, qjm
>            Reporter: James Thomas
>            Assignee: James Thomas
>             Fix For: 2.6.0
>
>         Attachments: HDFS-6634.2.patch, HDFS-6634.3.patch, HDFS-6634.4.patch, HDFS-6634.5.patch,
HDFS-6634.6.patch, HDFS-6634.7.patch, HDFS-6634.8.patch, HDFS-6634.9.patch, HDFS-6634.patch,
inotify-design.2.pdf, inotify-design.3.pdf, inotify-design.4.pdf, inotify-design.pdf, inotify-intro.2.pdf,
inotify-intro.pdf
>
>
> Design a mechanism for applications like search engines to access the HDFS edit stream.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message