ranger-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mehul Parikh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (RANGER-1501) Audit Flush to HDFS does not actually cause the audit logs to be flushed to HDFS
Date Thu, 27 Sep 2018 10:05:00 GMT

    [ https://issues.apache.org/jira/browse/RANGER-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630098#comment-16630098
] 

Mehul Parikh commented on RANGER-1501:
--------------------------------------

Committed to [ranger-0.7|https://github.com/apache/ranger/commit/a3be2390eeae26fa41147270d358e51a552fa55c]

> Audit Flush to HDFS does not actually cause the audit logs to be flushed to HDFS 
> ---------------------------------------------------------------------------------
>
>                 Key: RANGER-1501
>                 URL: https://issues.apache.org/jira/browse/RANGER-1501
>             Project: Ranger
>          Issue Type: Bug
>          Components: audit
>    Affects Versions: 0.7.0
>            Reporter: Yan
>            Assignee: Yan
>            Priority: Major
>             Fix For: 1.0.0
>
>         Attachments: 0001-RANGER-1501-Audit-Flush-to-HDFS-does-not-actually-ca.patch,
0001-RANGER-1501-Audit-Flush-to-HDFS-improvement.patch
>
>
> The reason is that HDFS file stream's flush() call does not really flush the data all
the way to disk, nor even makes the data visible to HDFS users. See the HDFS semantics of
the flush/sync at https://issues.apache.org/jira/browse/HADOOP-6313.
> Consequently the audit logs on HDFS won't be visible/durable from HDFS client until the
log file is closed. This will, among other issues, boost chances of losing audit logs in case
of system failure.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message