nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bryan Bende (JIRA)" <>
Subject [jira] [Commented] (NIFI-919) Support Splitting Avro Files
Date Fri, 04 Sep 2015 19:25:45 GMT


Bryan Bende commented on NIFI-919:

Thanks for reviewing Ryan. 

So moving from the splitting side of things thenm to the output side... did we decide if it
makes sense to support bare-record output here? and also, do we want to allow choosing of
output encoding (binary vs json)?

It would keep the first version of this fairly simple if we did binary datafile in, split
by records, and binary datafiles out.
However, want to make sure we are helping solve the most common real world scenarios that
people have.

> Support Splitting Avro Files
> ----------------------------
>                 Key: NIFI-919
>                 URL:
>             Project: Apache NiFi
>          Issue Type: New Feature
>            Reporter: Bryan Bende
>            Assignee: Bryan Bende
>            Priority: Minor
>             Fix For: 0.4.0
> Provide a processor that splits an Avro file into multiple smaller files. Would be nice
to have a configurable batch size so a user could produce single record files and also multi-record
files of smaller size than the original. Also consider making the output format configurable,
data file vs bare record.

This message was sent by Atlassian JIRA

View raw message