hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-5594) Exception in vectorized map join.
Date Tue, 22 Oct 2013 15:35:48 GMT

    [ https://issues.apache.org/jira/browse/HIVE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801928#comment-13801928
] 

Hudson commented on HIVE-5594:
------------------------------

FAILURE: Integrated in Hive-trunk-hadoop2 #516 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/516/])
HIVE-5594 : Exception in vectorized map join. (Jitendra Nath Pandey via Ashutosh Chauhan)
(hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1534578)
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorMapJoinOperator.java


> Exception in vectorized map join.
> ---------------------------------
>
>                 Key: HIVE-5594
>                 URL: https://issues.apache.org/jira/browse/HIVE-5594
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jitendra Nath Pandey
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5594.1.patch
>
>
> Following exception is being observed. The query is a 4-way map join with 1 fact table
and 4 dimension tables.
> 13/10/18 14:52:29 ERROR ql.Driver: FAILED: RuntimeException java.lang.reflect.InvocationTargetException
> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
> 	at org.apache.hadoop.hive.ql.exec.OperatorFactory.getVectorOperator(OperatorFactory.java:143)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer.vectorizeOperator(Vectorizer.java:658)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationNodeProcessor.process(Vectorizer.java:439)
> 	at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
> 	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:94)
> 	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:78)
> 	at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:54)
> 	at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
> 	at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
> 	at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:59)
> 	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:109)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationDispatcher.vectorizeMRTask(Vectorizer.java:335)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer$VectorizationDispatcher.dispatch(Vectorizer.java:276)
> 	at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
> 	at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:194)
> 	at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:139)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.Vectorizer.resolve(Vectorizer.java:472)
> 	at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:97)
> 	at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.compile(MapReduceCompiler.java:300)
> 	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:8410)
> 	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:284)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:451)
> 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:351)
> 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1004)
> 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:915)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:422)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:357)
> 	at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:455)
> 	at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:465)
> 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:125)
> 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:422)
> 	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:790)
> 	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)
> 	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:623)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> Caused by: java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> 	at org.apache.hadoop.hive.ql.exec.OperatorFactory.getVectorOperator(OperatorFactory.java:136)
> 	... 40 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Column _col7 is already
mapped to 31. Cannot remap to 37.
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.addToColumnMap(VectorizationContext.java:2130)
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorizationContext.addOutputColumn(VectorizationContext.java:2150)
> 	at org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator.<init>(VectorMapJoinOperator.java:122)
> 	... 45 more



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message