tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergio Esteves (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (TAJO-160) StorageManager throws InvalidInputException while running simple join query
Date Fri, 06 Sep 2013 03:33:51 GMT

     [ https://issues.apache.org/jira/browse/TAJO-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sergio Esteves resolved TAJO-160.
---------------------------------

       Resolution: Fixed
    Fix Version/s: 0.3-incubating
                   0.2-incubating
    
> StorageManager throws InvalidInputException while running simple join query
> ---------------------------------------------------------------------------
>
>                 Key: TAJO-160
>                 URL: https://issues.apache.org/jira/browse/TAJO-160
>             Project: Tajo
>          Issue Type: Bug
>          Components: storage
>         Environment: Ubuntu 12.04.2 LTS, Java 1.6.0_26 (Sun Microsystems Inc.), hadoop
2.0.4-alpha
>            Reporter: Sergio Esteves
>             Fix For: 0.2-incubating, 0.3-incubating
>
>
> While executing the query "select * from customer as c inner join nation as n on c.c_nationkey
= n.n_nationkey;", with nation and customer being the tables generated from TPCH, I got the
following:
> {code}
> tajo> select * from customer as c inner join nation as n on c.c_nationkey = n.n_nationkey;
> 2013-09-05 04:45:05,632 INFO  client.TajoClient (TajoClient.java:connectionToQueryMaster(190))
- Connected to Query Master (qid=q_1378350112573_0007, addr=146.XXX.XX.XX:8091)
> 2013-09-05 04:45:05,700 INFO  rpc.NettyClientBase (NettyClientBase.java:close(87)) -
Proxy is disconnected from 146.XXX.XX.XX:8091
> 2013-09-05 04:45:05,700 INFO  client.TajoClient (TajoClient.java:closeQuery(113)) - Closed
a QueryMaster connection (qid=q_1378350112573_0007, addr=computer3/146.XXX.XX.XX:8091)
> null
> tajo>
> {code}
> "select * from customer;" and "select * from nation;" returned correctly the tables.
> Here follows the yarn stderr user log:
> {code}
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.YarnTaskRunnerLauncherImpl
is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.AMRMClientImpl
is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.worker.AbstractResourceAllocator
is started.
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.TajoAsyncDispatcher
is started.
> 13/09/05 04:15:46 INFO master.TajoAsyncDispatcher: AsyncDispatcher started:q_1378350112573_0004
> 13/09/05 04:15:46 INFO service.AbstractService: Service:org.apache.tajo.master.querymaster.QueryMasterTask
is started.
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type INIT
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from
QUERY_NEW to QUERY_INIT
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type START
> 13/09/05 04:15:46 INFO rm.YarnRMContainerAllocator: Available Resource: <memory:6144,
vCores:0>
> 13/09/05 04:15:46 WARN querymaster.SubQuery: SubQuery (eb_1378350112573_0004_000001)
failed
> org.apache.tajo.storage.StorageManager$InvalidInputException
> 	at org.apache.tajo.storage.StorageManager.listStatus(StorageManager.java:440)
> 	at org.apache.tajo.storage.StorageManager.getSplits(StorageManager.java:622)
> 	at org.apache.tajo.master.querymaster.Repartitioner.createJoinTasks(Repartitioner.java:85)
> 	at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.createTasks(SubQuery.java:566)
> 	at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:449)
> 	at org.apache.tajo.master.querymaster.SubQuery$InitAndRequestContainer.transition(SubQuery.java:433)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> 	at org.apache.tajo.master.querymaster.SubQuery.handle(SubQuery.java:410)
> 	at org.apache.tajo.master.querymaster.Query$StartTransition.transition(Query.java:279)
> 	at org.apache.tajo.master.querymaster.Query$StartTransition.transition(Query.java:268)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:359)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> 	at org.apache.tajo.master.querymaster.Query.handle(Query.java:399)
> 	at org.apache.tajo.master.querymaster.Query.handle(Query.java:53)
> 	at org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:139)
> 	at org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
> 	at java.lang.Thread.run(Thread.java:679)
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from
QUERY_INIT to QUERY_RUNNING
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type SUBQUERY_COMPLETED
> 13/09/05 04:15:46 FATAL master.TajoAsyncDispatcher: Error in dispatcher thread:SUBQUERY_COMPLETED
> java.lang.ClassCastException: org.apache.tajo.master.event.QueryDiagnosticsUpdateEvent
cannot be cast to org.apache.tajo.master.event.SubQueryCompletedEvent
> 	at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:291)
> 	at org.apache.tajo.master.querymaster.Query$SubQueryCompletedTransition.transition(Query.java:284)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:382)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:299)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:43)
> 	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:445)
> 	at org.apache.tajo.master.querymaster.Query.handle(Query.java:399)
> 	at org.apache.tajo.master.querymaster.Query.handle(Query.java:53)
> 	at org.apache.tajo.master.TajoAsyncDispatcher.dispatch(TajoAsyncDispatcher.java:139)
> 	at org.apache.tajo.master.TajoAsyncDispatcher$1.run(TajoAsyncDispatcher.java:79)
> 	at java.lang.Thread.run(Thread.java:679)
> 13/09/05 04:15:46 INFO querymaster.Query: Processing q_1378350112573_0004 of type SUBQUERY_COMPLETED
> 13/09/05 04:15:46 INFO querymaster.Query: q_1378350112573_0004 Query Transitioned from
QUERY_RUNNING to QUERY_FAILED
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message