nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph Witt (JIRA)" <>
Subject [jira] [Commented] (NIFI-1868) Add support for Hive Streaming
Date Tue, 07 Jun 2016 04:22:20 GMT


Joseph Witt commented on NIFI-1868:

[~mattyb149] how about 1.0.0 only?

> Add support for Hive Streaming
> ------------------------------
>                 Key: NIFI-1868
>                 URL:
>             Project: Apache NiFi
>          Issue Type: New Feature
>            Reporter: Matt Burgess
>            Assignee: Matt Burgess
>             Fix For: 1.0.0, 0.7.0
> Traditionally adding new data into Hive requires gathering a large amount of data onto
HDFS and then periodically adding a new partition. This is essentially a “batch insertion”.
Insertion of new data into an existing partition is not permitted. Hive Streaming API allows
data to be pumped continuously into Hive. The incoming data can be continuously committed
in small batches of records into an existing Hive partition or table. Once data is committed
it becomes immediately visible to all Hive queries initiated subsequently.
> This case is to add a PutHiveStreaming processor to NiFi, to leverage the Hive Streaming
API to allow continuous streaming of data into a Hive partition/table.

This message was sent by Atlassian JIRA

View raw message