hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roshan Naik (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5687) Streaming support in Hive
Date Thu, 27 Mar 2014 21:40:18 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Roshan Naik updated HIVE-5687:
------------------------------

    Attachment: HIVE-5687.v3.patch

- Addressed review comments from Alan. 
- Tweaked the APIs
- Wrote Java docs
- Added heartbeat support
- Improved log messages
- More tests
- Fixes for multiple bugs found during unit testing and manual testing

> Streaming support in Hive
> -------------------------
>
>                 Key: HIVE-5687
>                 URL: https://issues.apache.org/jira/browse/HIVE-5687
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Roshan Naik
>            Assignee: Roshan Naik
>         Attachments: 5687-api-spec4.pdf, 5687-draft-api-spec.pdf, 5687-draft-api-spec2.pdf,
5687-draft-api-spec3.pdf, HIVE-5687.patch, HIVE-5687.v2.patch, HIVE-5687.v3.patch
>
>
> Implement support for Streaming data into HIVE.
> - Provide a client streaming API 
> - Transaction support: Clients should be able to periodically commit a batch of records
atomically
> - Immediate visibility: Records should be immediately visible to queries on commit
> - Should not overload HDFS with too many small files
> Use Cases:
>  - Streaming logs into HIVE via Flume
>  - Streaming results of computations from Storm



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message