hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14574) use consistent hashing for LLAP consistent splits to alleviate impact from cluster changes
Date Thu, 18 Aug 2016 21:55:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427233#comment-15427233
] 

Prasanth Jayachandran commented on HIVE-14574:
----------------------------------------------

The 3 byte difference will still be there based on what split strategy is chose. If a big
file is chosen by ETL split strategy the first split will start from 3 offset. If chosen by
BI split strategy the first split will start from 0. My fix was related to inconsistently
choosing strategies based on AM cache being on or off. 

> use consistent hashing for LLAP consistent splits to alleviate impact from cluster changes
> ------------------------------------------------------------------------------------------
>
>                 Key: HIVE-14574
>                 URL: https://issues.apache.org/jira/browse/HIVE-14574
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-14574.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message