hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2360) create dynamic partition if and only if intermediate source has files
Date Tue, 09 Aug 2011 23:31:30 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081995#comment-13081995
] 

jiraposter@reviews.apache.org commented on HIVE-2360:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1442/
-----------------------------------------------------------

Review request for hive, Ning Zhang and Siying Dong.


Summary
-------

There are some conditions under which partition descriptions are created in memory and committed
to the metastore despite there being no intermediate or final finals in that directory (due
to dynamic partitioning).
In this change, a check is done to only call loadPartitions that have files in them.


This addresses bug HIVE-2360.
    https://issues.apache.org/jira/browse/HIVE-2360


Diffs
-----

  trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 1155968 

Diff: https://reviews.apache.org/r/1442/diff


Testing
-------

Unit tests pass


Thanks,

Franklin



> create dynamic partition if and only if intermediate source has files
> ---------------------------------------------------------------------
>
>                 Key: HIVE-2360
>                 URL: https://issues.apache.org/jira/browse/HIVE-2360
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Franklin Hu
>            Assignee: Franklin Hu
>            Priority: Minor
>             Fix For: 0.8.0
>
>         Attachments: hive-2360.1.patch, hive-2360.2.patch
>
>
> There are some conditions under which a partition description is created due to insert
overwriting a table using dynamic partitioning for partitions that that are empty (have no
files).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message