nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ryan Blue (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-238) Add processors to write datasets using Kite
Date Thu, 05 Mar 2015 17:00:43 GMT

    [ https://issues.apache.org/jira/browse/NIFI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349085#comment-14349085
] 

Ryan Blue commented on NIFI-238:
--------------------------------

[~markap14], thanks for bumping this. I thought you had merged it already.

I've removed what dependencies I can, but it's still ~33MB. There's not much more to remove.
The Hadoop nar is ~26MB and Kite needs the Hadoop client jars. Then we have guava, avro, parquet,
and Kite itself to account for the other 7MB. I've removed all of the optional features, like
writing directly to HBase or Hive, to get the size down. I'll add them back later so we can
get a size baseline and try to keep this as small as possible.

Is this sufficient? Anything I missed that can go?

> Add processors to write datasets using Kite
> -------------------------------------------
>
>                 Key: NIFI-238
>                 URL: https://issues.apache.org/jira/browse/NIFI-238
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Ryan Blue
>
> I think it would be great to have a set of processors that parse incoming flow files
and add the data to Kite datasets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message