nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryan Bende (Jira)" <>
Subject [jira] [Updated] (NIFI-7346) Provenance Repository can stop producing data and become empty
Date Thu, 09 Apr 2020 17:35:00 GMT


Bryan Bende updated NIFI-7346:
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

> Provenance Repository can stop producing data and become empty
> --------------------------------------------------------------
>                 Key: NIFI-7346
>                 URL:
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>            Priority: Major
>             Fix For: 1.12.0
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
> The Provenance Repository is designed to periodically age off old data. This is done
by looking at the Last Modified Time for all event files, and then removing any file whose
Last Modified Time is longer than the configured ""
> However, it does this without first checking if the event file is the "active" event
file. As a result, it can delete the event file while it is being written to. If this happens,
on Linux and OSX, the delete will succeed and any further writes to the underlying file handle
will simply disappear. And checking the size of the file will always return 0.
> As a result, the Event File will never roll over because it never reaches the max size.
And it doesn't roll over based on time due to NIFI-7339. As a result, all data will be aged
off from the Provenance Repository and no new data will be added until restart.

This message was sent by Atlassian Jira

View raw message