hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6634) inotify in HDFS
Date Wed, 09 Jul 2014 08:54:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14056010#comment-14056010
] 

Steve Loughran commented on HDFS-6634:
--------------------------------------

I'd argue that making the audit log generally accessible via some kafka stream would be broadly
useful, as it would support other use cases being discussed such as "identify and delete temporary
files", or, as spotify do with their audit log -identify files that haven't been read for
a while.

If custom code is needed, that's what we call "a library"

> inotify in HDFS
> ---------------
>
>                 Key: HDFS-6634
>                 URL: https://issues.apache.org/jira/browse/HDFS-6634
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: hdfs-client, namenode, qjm
>            Reporter: James Thomas
>            Assignee: James Thomas
>         Attachments: inotify-intro.pdf
>
>
> Design a mechanism for applications like search engines to access the HDFS edit stream.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message