nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Wicks (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (NIFI-6559) FlowFile Repo Journal Recovery Should not Fail if External Overflow Files are Missing
Date Fri, 16 Aug 2019 17:26:00 GMT

    [ https://issues.apache.org/jira/browse/NIFI-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16909243#comment-16909243
] 

Peter Wicks edited comment on NIFI-6559 at 8/16/19 5:25 PM:
------------------------------------------------------------

If I wrote an offline FlowFile Repository checkpoint utility, and put it in the NiFi utilities,
do you think this would be an appropriate option that I could add to it there?


was (Author: patricker):
If I wrote an offline FlowFile Repository compaction utility, and put it in the NiFi utilities,
do you think this would be an appropriate option that I could add to it there?

> FlowFile Repo Journal Recovery Should not Fail if External Overflow Files are Missing
> -------------------------------------------------------------------------------------
>
>                 Key: NIFI-6559
>                 URL: https://issues.apache.org/jira/browse/NIFI-6559
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>            Reporter: Peter Wicks
>            Assignee: Peter Wicks
>            Priority: Minor
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> When NiFi is journaling the FlowFile repository changes to disk it sometimes writes Overflow
files if it exceeds a certain memory threshold.
> These files are tracked inside of the *.journal files as External File References. If
one of these external file references is deleted or lost the entire journal fails to recover.
> Instead, I feel this should work more like FlowFile's that lose their queue, or Content
in the Content Repository that has lost it's FlowFile.  Log it, and move on.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Mime
View raw message