hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2543) Compact index table's files merged in creation
Date Wed, 02 Nov 2011 01:21:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141830#comment-13141830
] 

jiraposter@reviews.apache.org commented on HIVE-2543:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2667/
-----------------------------------------------------------

Review request for hive, Yongqiang He, Ning Zhang, and namit jain.


Summary
-------

By explicitely setting the two variable HIVEMERGEMAPFILES and HIVEMERGEMAPREDFILES to false
before compiling the query to build the index, it guarantees that there will not be a merge
task.


This addresses bug HIVE-2543.
    https://issues.apache.org/jira/browse/HIVE-2543


Diffs
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/index/AggregateIndexHandler.java 1196155 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java 1196155


Diff: https://reviews.apache.org/r/2667/diff


Testing
-------

I ran an explain plan on a command to rebuild an index and verified it did not contain a merge
task.

I also verified all the index related tests still pass.


Thanks,

Kevin


                
> Compact index table's files merged in creation
> ----------------------------------------------
>
>                 Key: HIVE-2543
>                 URL: https://issues.apache.org/jira/browse/HIVE-2543
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Kevin Wilfong
>            Assignee: Kevin Wilfong
>         Attachments: HIVE-2543.1.patch.txt
>
>
> When a compact index is built there is the possibility of a merge task at the end of
the task tree.  If this happens, the index table's files will no longer be sorted.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message