hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Pivovarov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10704) Errors in Tez HashTableLoader when estimated table size is 0
Date Fri, 15 May 2015 01:54:59 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544766#comment-14544766
] 

Alexander Pivovarov commented on HIVE-10704:
--------------------------------------------

you calling "desc.getParentDataSizes().get(pos)" two times...
Jason, can you "rbt post -g yes" and attach the link?


> Errors in Tez HashTableLoader when estimated table size is 0
> ------------------------------------------------------------
>
>                 Key: HIVE-10704
>                 URL: https://issues.apache.org/jira/browse/HIVE-10704
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Jason Dere
>            Assignee: Jason Dere
>         Attachments: HIVE-10704.1.patch
>
>
> Couple of issues:
> - If the table sizes in MapJoinOperator.getParentDataSizes() are 0 for all tables, the
largest small table selection is wrong and could select the large table (which results in
NPE)
> - The memory estimates can either divide-by-zero, or allocate 0 memory if the table size
is 0. Try to come up with a sensible default for this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message