hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhenxiao Luo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3423) merge_dynamic_partition.q is failing when running hive on real cluster
Date Sun, 02 Sep 2012 03:44:07 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446871#comment-13446871
] 

Zhenxiao Luo commented on HIVE-3423:
------------------------------------

@Edward: I just found that HIVE-3295 already fixes the bug by a redo of FileUtils. This is
definitely better than adding commons-compress into hive-exec. Thanks a lot for your guide.
How about I take HIVE-3295's patch, and mark this as duplicate?
                
> merge_dynamic_partition.q is failing when running hive on real cluster
> ----------------------------------------------------------------------
>
>                 Key: HIVE-3423
>                 URL: https://issues.apache.org/jira/browse/HIVE-3423
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.10.0
>            Reporter: Zhenxiao Luo
>            Assignee: Zhenxiao Luo
>             Fix For: 0.10.0
>
>         Attachments: HIVE-3423.1.patch.txt
>
>
> merge_dynamic_partition (and a number of other qfiles) is failing when running the current
hive on a real cluster:
> java.lang.RuntimeException: java.lang.NoClassDefFoundError: org/apache/commons/compress/compressors/gzip/GzipCompressorOutputStream
> 	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.lang.NoClassDefFoundError: org/apache/commons/compress/compressors/gzip/GzipCompressorOutputStream
> 	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.getDynPartDirectory(FileSinkOperator.java:644)
> 	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.getDynOutPaths(FileSinkOperator.java:613)
> 	at 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message