nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph Witt (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-378) MergeContent in Defragment mode will merge fragments without checking index
Date Wed, 03 Jun 2015 16:49:37 GMT

    [ https://issues.apache.org/jira/browse/NIFI-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571305#comment-14571305
] 

Joseph Witt commented on NIFI-378:
----------------------------------

[~mosermw] Can you describe why this is a bug of MergeContent?  This sounds like a violation
of the agreement.  It merges, in the case of defragment, keyed by the fragment identifier
exclusively.  Index simply provides ordering. 

What is requested sounds outside of that intent.

Thanks
joe

> MergeContent in Defragment mode will merge fragments without checking index
> ---------------------------------------------------------------------------
>
>                 Key: NIFI-378
>                 URL: https://issues.apache.org/jira/browse/NIFI-378
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 0.0.1
>            Reporter: Michael Moser
>            Priority: Minor
>
> When in Defragment mode, the MergeContent processor looks for fragment.identifier and
fragment.count attributes in order to place FlowFiles in the correct bin.  The fragment.index
attribute is ignored.
> If you happen to have many FlowFile in the queue to MergeContent, and they all have fragment.identifier=foo
and fragment.count=2, then it will merge two FlowFiles that have fragment.index=1 or it will
merge two FlowFiles that have fragment.index=2.
> Granted this may seem odd.  The use case is to give the MergeContent processor two input
queues.  We configure one queue to contain files with fragment.index=1 and the other queue
to contain files with fragment.index=2.  We want one file from each queue to be merged.  Instead
it will merge two files from the same queue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message