hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Namit Jain (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1944) dynamic partition insert creating different directories for the same partition during merge
Date Wed, 02 Feb 2011 17:33:28 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12989720#comment-12989720
] 

Namit Jain commented on HIVE-1944:
----------------------------------

+1

> dynamic partition insert creating different directories for the same partition during
merge
> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1944
>                 URL: https://issues.apache.org/jira/browse/HIVE-1944
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1944.patch
>
>
> If dynamic partition insert generates multiple partitions and some partitions need to
be merge (MR task) and some need not (move task), parallel execution could cause the move
task finish first and created the partition directory (say ds=1) first. When the MR job finished,
it created a different directory (ds=1_1) for the same partition ds=1. 

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message