hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Thomas (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6634) inotify in HDFS
Date Wed, 09 Jul 2014 17:21:05 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056474#comment-14056474

James Thomas commented on HDFS-6634:

That would require this project to be a third-party service, much like the work presented
in http://www.youtube.com/watch?v=7KumMKqBtr8

So I think the same concerns raised in the Q & A (starting around 25:30) would apply here
-- in particular, changes to the format of the audit log would cause problems for user applications.
I think tighter integration with HDFS and exposure of the edits in ProtoBuf form is important.

> inotify in HDFS
> ---------------
>                 Key: HDFS-6634
>                 URL: https://issues.apache.org/jira/browse/HDFS-6634
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client, namenode, qjm
>            Reporter: James Thomas
>            Assignee: James Thomas
>         Attachments: inotify-intro.pdf
> Design a mechanism for applications like search engines to access the HDFS edit stream.

This message was sent by Atlassian JIRA

View raw message