hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1416) Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
Date Wed, 23 Jun 2010 22:11:53 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John Sichi updated HIVE-1416:
-----------------------------

    Status: Open  (was: Patch Available)

Ning, this ran through cleanly with Hadoop 0.17 (where I verified that it fixes the problem),
but on Hadoop 0.20, it results in a lot of test failures.  These aren't just diffs due to
missing ORDER BY; values are actually missing from the results.


> Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1416
>                 URL: https://issues.apache.org/jira/browse/HIVE-1416
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: HIVE-1416.2.patch, HIVE-1416.patch
>
>
> Hive parses the file name generated by tasks to figure out the task ID in order to generate
files for empty buckets. Different hadoop versions and execution mode have different ways
of naming  output files by mappers/reducers. We need to move the parsing code to shims. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message