tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "JaeHwa Jung (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TAJO-423) Using aggregation query on local file system.
Date Mon, 16 Dec 2013 10:05:07 GMT
JaeHwa Jung created TAJO-423:
--------------------------------

             Summary: Using aggregation query on local file system.
                 Key: TAJO-423
                 URL: https://issues.apache.org/jira/browse/TAJO-423
             Project: Tajo
          Issue Type: Bug
    Affects Versions: 0.8-incubating
            Reporter: JaeHwa Jung
             Fix For: 0.8-incubating


I found a bug to use aggregation query which scan external table stored on local file system
as follows:

* make just directory on local file system.
** location: /Users/blrunner/data/tajo/table1
* create table on tsql
** create external table table1 (id int, name text, score float, type text) using csv with
('csvfile.delimiter'='|') location 'file:/Users/blrunner/data/tajo/table1';
* query test 
** select count(*) from table1: *PASSED*
** select id, count(*) from table1 group by id: *PASSED*
* make csv file on location which is '/Users/blrunner/data/tajo/table1'
* query test again
** select count(*) from table1: *PASSED*
** select id, count(*) from table1 group by id: *{color:red}FAILED{color}*
{code:xml}
2013-12-16 18:54:38,080 INFO  planner.PhysicalPlannerImpl (PhysicalPlannerImpl.java:createBestAggregationPlan(727))
- The planner chooses [Hash Aggregation]
2013-12-16 18:54:38,080 INFO  planner.PhysicalPlannerImpl (PhysicalPlannerImpl.java:createInMemoryHashAggregation(679))
- The planner chooses [Hash Aggregation]
2013-12-16 18:54:38,080 ERROR worker.Task (Task.java:run(366)) - java.lang.IllegalArgumentException:
The number of partitions must be positive: 0
	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
	at org.apache.tajo.engine.planner.logical.StoreTableNode.setPartitions(StoreTableNode.java:88)
	at org.apache.tajo.engine.planner.PhysicalPlannerImpl.buildOutputOperator(PhysicalPlannerImpl.java:97)
	at org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:80)
	at org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:44)
	at org.apache.tajo.worker.Task.run(Task.java:355)
	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:376)
	at java.lang.Thread.run(Thread.java:680)

2013-12-16 18:54:38,081 INFO  worker.Task (Task.java:run(411)) - Task Counter - total:5, succeeded:
2, failed: 3
2013-12-16 18:54:38,081 INFO  worker.TaskRunner (TaskRunner.java:run(318)) - Request GetTask:
eb_1387181184478_0005_000001,container_1387181184478_0005_01_000003
2013-12-16 18:54:38,081 ERROR querymaster.QueryUnitAttempt (QueryUnitAttempt.java:transition(292))
- FROM 192.168.0.187 >> java.lang.IllegalArgumentException: The number of partitions
must be positive: 0
	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:119)
	at org.apache.tajo.engine.planner.logical.StoreTableNode.setPartitions(StoreTableNode.java:88)
	at org.apache.tajo.engine.planner.PhysicalPlannerImpl.buildOutputOperator(PhysicalPlannerImpl.java:97)
	at org.apache.tajo.engine.planner.PhysicalPlannerImpl.createPlan(PhysicalPlannerImpl.java:80)
	at org.apache.tajo.worker.TajoQueryEngine.createPlan(TajoQueryEngine.java:44)
	at org.apache.tajo.worker.Task.run(Task.java:355)
	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:376)
	at java.lang.Thread.run(Thread.java:680)
{code}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message