hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roshan Naik (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11983) Hive streaming API uses incorrect logic to assign buckets to incoming records
Date Thu, 01 Oct 2015 00:01:16 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939082#comment-14939082
] 

Roshan Naik commented on HIVE-11983:
------------------------------------

tried a few different things.. but unable to resolve the RB issue.

> Hive streaming API uses incorrect logic to assign buckets to incoming records
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-11983
>                 URL: https://issues.apache.org/jira/browse/HIVE-11983
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog, Transactions
>    Affects Versions: 1.2.1
>            Reporter: Roshan Naik
>            Assignee: Roshan Naik
>              Labels: streaming, streaming_api
>         Attachments: HIVE-11983.patch, HIVE-11983.v2.patch
>
>
> The Streaming API tries to distribute records evenly into buckets. 
> All records in every Transaction that is part of TransactionBatch goes to the same bucket
and a new bucket number is chose for each TransactionBatch.
> Fix: API needs to hash each record to determine which bucket it belongs to. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message