hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1416) Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
Date Tue, 22 Jun 2010 23:35:50 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881452#action_12881452
] 

John Sichi commented on HIVE-1416:
----------------------------------

I think a profiler would show it as negligible in that context, but I won't argue the point.
 Can you fix the other one?


> Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1416
>                 URL: https://issues.apache.org/jira/browse/HIVE-1416
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: HIVE-1416.patch
>
>
> Hive parses the file name generated by tasks to figure out the task ID in order to generate
files for empty buckets. Different hadoop versions and execution mode have different ways
of naming  output files by mappers/reducers. We need to move the parsing code to shims. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message