nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joey Frazee (Jira)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-7090) Create Processors for Transactional Hadoop Table Formats
Date Sat, 01 Feb 2020 21:30:00 GMT

    [ https://issues.apache.org/jira/browse/NIFI-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17028215#comment-17028215
] 

Joey Frazee commented on NIFI-7090:
-----------------------------------

Note: There's a chance there could be a coherent way to do these as one to avoid the processor
bloat.

> Create Processors for Transactional Hadoop Table Formats
> --------------------------------------------------------
>
>                 Key: NIFI-7090
>                 URL: https://issues.apache.org/jira/browse/NIFI-7090
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Joey Frazee
>            Assignee: Joey Frazee
>            Priority: Minor
>
> NiFi's List/Fetch/Put* processors don't know how to do the right thing for newer transactional
table formats; e.g., Apache Hudi (incubating), Apache Iceberg (incubating), and Delta Lake
(LF). It'd be useful to have processors that could work with these table formats and were
aware of their data and metadata log protocols.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message