hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <>
Subject [jira] [Created] (HIVE-5000) hive.optimize.skewjoin can cause long running queries to fail
Date Mon, 05 Aug 2013 19:38:48 GMT
Brock Noland created HIVE-5000:

             Summary: hive.optimize.skewjoin can cause long running queries to fail
                 Key: HIVE-5000
             Project: Hive
          Issue Type: Bug
            Reporter: Brock Noland
            Priority: Minor

MapReduce Total cumulative CPU time: 5 days 19 hours 7 minutes 8 seconds 540 msec
Ended Job = job_201301311513_15328 File hdfs://xxxx:8020/tmp/hive-scripts/hive_2013-02-06_10-23-17_026_1520760778337129611/
-mr-10002/hive_skew_join_bigkeys_0 does not exist.
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(
at org.apache.hadoop.hive.ql.plan.ConditionalResolverSkewJoin.getTasks(
at org.apache.hadoop.hive.ql.exec.ConditionalTask.execute(
at org.apache.hadoop.hive.ql.exec.Task.executeTask(
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(
at org.apache.hadoop.hive.ql.Driver.launchTask(
at org.apache.hadoop.hive.ql.Driver.execute(
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(
at org.apache.hadoop.hive.cli.CliDriver.processCmd(
at org.apache.hadoop.hive.cli.CliDriver.processLine(
at org.apache.hadoop.hive.cli.CliDriver.processLine(
at org.apache.hadoop.hive.cli.CliDriver.processReader(
at org.apache.hadoop.hive.cli.CliDriver.processFile(
at org.apache.hadoop.hive.cli.CliDriver.main(
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
at java.lang.reflect.Method.invoke(
at org.apache.hadoop.util.RunJar.main(
Ended Job = -1079843427, job is filtered out (removed at runtime).
8390065 Rows loaded to hdfs://xxxx/tmp/hive-scripts/hive_2013-02-06_10-23-17_026_1520760778337129611/-ext-10000
MapReduce Jobs Launched:
Job 0: Map: 970 Reduce: 260 Cumulative CPU: 500828.54 sec HDFS Read: 0 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 5 days 19 hours 7 minutes 8 seconds 540 msec

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message