nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aldrin Piri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-892) If the "nifi.flowfile.repository.partitions" property is changed to a smaller value, FlowFIles not restored properly
Date Mon, 24 Aug 2015 22:32:46 GMT

    [ https://issues.apache.org/jira/browse/NIFI-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14710175#comment-14710175
] 

Aldrin Piri commented on NIFI-892:
----------------------------------

Verified the described badness with your steps outlined above.  

Applied patch.  Build, contrib, and tests all good.  Performed same process with a fresh state
and patch applied and did not experience the same issues across several iterations of killing/restarting.
 

Nice find and fix.  +1

> If the "nifi.flowfile.repository.partitions" property is changed to a smaller value,
FlowFIles not restored properly
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: NIFI-892
>                 URL: https://issues.apache.org/jira/browse/NIFI-892
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>            Priority: Critical
>             Fix For: 0.3.0
>
>         Attachments: 0001-NIFI-892-If-nifi.flowfile.repository.partitions-prop.patch
>
>
> To recreate:
> 1. Start NiFi and run some data through it.
> 2. Kill NiFi (may not happen if the FlowFile repo was just checkpointed; the logs would
indicate this)
> 3. Change the "nifi.flowfile.repository.partitions" property in conf/nifi.properties
from 256 to 6
> 4. Restart NiFi
> At this point, any updates to the Write-Ahead Log that occurred on journal-7 through
journal-256 will be lost. This can cause some bizarre behavior, such as FlowFiles that have
finished processor could be reprocessed. FlowFiles could also lose attributes (or could be
re-processed without having all of their attributes present).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message