hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ning Zhang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1944) dynamic partition insert creating different directories for the same partition during merge
Date Wed, 02 Feb 2011 07:15:29 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ning Zhang updated HIVE-1944:
-----------------------------

    Attachment: HIVE-1944.patch

this patch makes the move task a dependent of the mr task.

> dynamic partition insert creating different directories for the same partition during
merge
> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1944
>                 URL: https://issues.apache.org/jira/browse/HIVE-1944
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1944.patch
>
>
> If dynamic partition insert generates multiple partitions and some partitions need to
be merge (MR task) and some need not (move task), parallel execution could cause the move
task finish first and created the partition directory (say ds=1) first. When the MR job finished,
it created a different directory (ds=1_1) for the same partition ds=1. 

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message