hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pengcheng Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10677) hive.exec.parallel=true has problem when it is used for analyze table column stats
Date Tue, 19 May 2015 21:59:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14551310#comment-14551310
] 

Pengcheng Xiong commented on HIVE-10677:
----------------------------------------

[~ashutoshc] and [~jpullokkaran], could you please review the patch? Thanks.

> hive.exec.parallel=true has problem when it is used for analyze table column stats
> ----------------------------------------------------------------------------------
>
>                 Key: HIVE-10677
>                 URL: https://issues.apache.org/jira/browse/HIVE-10677
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Pengcheng Xiong
>            Assignee: Pengcheng Xiong
>         Attachments: HIVE-10677.01.patch
>
>
> To reproduce it, in q tests.
> {code}
> hive> set hive.exec.parallel;
> hive.exec.parallel=true
> hive> analyze table src compute statistics for columns;
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.ColumnStatsTask
> java.lang.RuntimeException: Error caching map.xml: java.io.IOException: java.lang.InterruptedException
> 	at org.apache.hadoop.hive.ql.exec.Utilities.setBaseWork(Utilities.java:747)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.setMapWork(Utilities.java:682)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.setMapRedWork(Utilities.java:674)
> 	at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:375)
> 	at org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:137)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:75)
> Caused by: java.io.IOException: java.lang.InterruptedException
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:541)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:455)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
> 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)
> 	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:646)
> 	at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:472)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:460)
> 	at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:426)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:887)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:784)
> 	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:773)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.setBaseWork(Utilities.java:715)
> 	... 7 more
> hive> Job Submission failed with exception 'java.lang.RuntimeException(Error caching
map.xml: java.io.IOException: java.lang.InterruptedException)'
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message