nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-912) Support extracting metadata from Avro file headers
Date Wed, 16 Sep 2015 14:05:45 GMT

    [ https://issues.apache.org/jira/browse/NIFI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14768978#comment-14768978
] 

ASF subversion and git services commented on NIFI-912:
------------------------------------------------------

Commit 100799941510b085b71394a757d86b9845ab993d in nifi's branch refs/heads/master from [~bbende]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=1007999 ]

NIFI-912 Initial version of ExtractAvroMetadata processor.
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values


> Support extracting metadata from Avro file headers
> --------------------------------------------------
>
>                 Key: NIFI-912
>                 URL: https://issues.apache.org/jira/browse/NIFI-912
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Bryan Bende
>            Assignee: Bryan Bende
>            Priority: Minor
>             Fix For: 0.4.0
>
>         Attachments: NIFI-912-2.patch, NIFI-912-3.patch, NIFI-912.patch
>
>
> Extract metadata from Avro file headers to FlowFile attributes so that downstream processors
can make decisions, such as merging together records of compatible schemas (i.e. the correlation
attribute).
> Information to extract:
> - Schema definition (full, not fp)
> - Schema fingerprint
> - Schema root record name (if schema is a record)
> - Key/value metadata, like compression codec



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message