hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John Sichi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-1416) Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
Date Wed, 23 Jun 2010 22:18:51 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12881921#action_12881921
] 

John Sichi commented on HIVE-1416:
----------------------------------

Attached junit-noframes.html with the failures (but not the diffs).

Example diff snippet from union6.q:

@@ -233,7 +233,6 @@
 406	val_406
 66	val_66
 98	val_98
-tst1	500


> Dynamic partition inserts left empty files uncleaned in hadoop 0.17 local mode
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1416
>                 URL: https://issues.apache.org/jira/browse/HIVE-1416
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0, 0.7.0
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>             Fix For: 0.6.0, 0.7.0
>
>         Attachments: HIVE-1416.2.patch, HIVE-1416.patch, junit-noframes.html
>
>
> Hive parses the file name generated by tasks to figure out the task ID in order to generate
files for empty buckets. Different hadoop versions and execution mode have different ways
of naming  output files by mappers/reducers. We need to move the parsing code to shims. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message