hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4606) Implement vector group by hash spill
Date Sun, 09 Jun 2013 07:30:22 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678964#comment-13678964
] 

Ashutosh Chauhan commented on HIVE-4606:
----------------------------------------

It probably is a good idea to use(or enhance) ql/src/java/org/apache/hadoop/hive/ql/util/JavaDataModel.java
for estimating memory sizes of object than adding a new one.
                
> Implement vector group by hash spill
> ------------------------------------
>
>                 Key: HIVE-4606
>                 URL: https://issues.apache.org/jira/browse/HIVE-4606
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Processor
>    Affects Versions: vectorization-branch
>            Reporter: Remus Rusanu
>            Assignee: Remus Rusanu
>             Fix For: vectorization-branch
>
>         Attachments: HIVE-4606.1.patch.txt, HIVE-4606.2.patch.txt
>
>
> the row mode GBy operator is capable of spilling the hash map (by emitting it into the
M/R and deleting the keys emitted) to conform to emmory constraints. The VGBy should be able
to do the same.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message