tajo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Seungun Choe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TAJO-246) java.lang.ArrayIndexOutOfBoundsException occurs sometimes
Date Sun, 13 Oct 2013 07:25:41 GMT
Seungun Choe created TAJO-246:
---------------------------------

             Summary: java.lang.ArrayIndexOutOfBoundsException occurs sometimes
                 Key: TAJO-246
                 URL: https://issues.apache.org/jira/browse/TAJO-246
             Project: Tajo
          Issue Type: Bug
            Reporter: Seungun Choe


{code}
---------------------------------------------------------------
Execution Block Graph (TERMINAL - eb_1381647894474_0002_000004)
-------------------------------------------------------------------------------
|-eb_1381647894474_0002_000004
   |-eb_1381647894474_0002_000003
      |-eb_1381647894474_0002_000002
      |-eb_1381647894474_0002_000001
-------------------------------------------------------------------------------

=======================================================
Block Id: eb_1381647894474_0002_000001 [LEAF]
=======================================================

[Outgoing]
[q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)

Table Subquery (alias = b)
"Scan" : {"table":"web_category_info", "qual": "aa.kk (TEXT(0)) = car", "target list": aa.cc
(TEXT(0)), aa.pp (TEXT(0)), aa.dd (TEXT(0)), aa.id (TEXT(0)), aa.ee (TEXT(0)), aa.bb (TEXT(0)),
  "out schema": {aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd (TEXT(0)),aa.id (TEXT(0)),aa.ee (TEXT(0)),aa.bb
(TEXT(0))}
  "in schema": {aa.kk (TEXT(0)),aa.cc (TEXT(0)),aa.pp (TEXT(0)),aa.dd (TEXT(0)),aa.id (TEXT(0)),aa.ee
(TEXT(0)),web_category_info.open_date (TEXT(0)),aa.cnt (INT8(0)),aa.bb (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000002 [LEAF]
=======================================================

[Outgoing]
[q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)

Table Subquery (alias = a)
"Scan" : {"table":"table1", "qual": "table1.col5 (TEXT(0)) = 109 AND table1.col2 (TEXT(0))
= data1", "target list": table1.col5 (TEXT(0)) as vdate, table1.col6 (TEXT(0)) as vcol6, table1.col10
(TEXT(0)), table1.col1 (TEXT(0)), table1.col2 (TEXT(0)) as pt, split_part(split_part(table1.skip
(TEXT(0)),clubid=,2),&,1) as id,
  "out schema": {vdate (TEXT(0)),vcol6 (TEXT(0)),table1.col10 (TEXT(0)),table1.col1 (TEXT(0)),pt
(TEXT(0)),id (TEXT(0))}
  "in schema": {table1.col1 (TEXT(0)),table1.col10 (TEXT(0)),table1.col2 (TEXT(0)),table1.skip
(TEXT(0)),table1.col5 (TEXT(0)),table1.col6 (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000003 [INTERMEDIATE]
=======================================================

[Incoming]
[q_1381647894474_0002] 1 => 3 (type=HASH_PARTITION, key=id, num=32)
[q_1381647894474_0002] 2 => 3 (type=HASH_PARTITION, key=id, num=32)

[Outgoing]
[q_1381647894474_0002] 3 => 4 (type=NONE_PARTITION)

"Join": "joinType": " INNER", "qual": a.id (TEXT(0)) = b.id (TEXT(0)), "target list": a.col10
(TEXT(0)), a.col1 (TEXT(0)), a.pt (TEXT(0)), b.skip (TEXT(0)), a.id (TEXT(0)), b.name (TEXT(0)),
?int8_0 (INT8(0)), b.category (TEXT(0)), b.sub_query (TEXT(0)), b.keyword (TEXT(0)), a.vcol6
(TEXT(0)), a.vdate (TEXT(0))
"out schema: {a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt (TEXT(0)),b.skip (TEXT(0)),a.id (TEXT(0)),b.name
(TEXT(0)),?int8_0 (INT8(0)),b.category (TEXT(0)),b.sub_query (TEXT(0)),b.keyword (TEXT(0)),a.vcol6
(TEXT(0)),a.vdate (TEXT(0))}
"in schema: {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip (TEXT(0)),b.id (TEXT(0)),b.name
(TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0)),a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10
(TEXT(0)),a.col1 (TEXT(0)),a.pt (TEXT(0)),a.id (TEXT(0))}
"Scan" : {"table":"eb_1381647894474_0002_000001",
  "out schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip (TEXT(0)),b.id (TEXT(0)),b.name
(TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0))}
  "in schema": {b.category (TEXT(0)),b.sub_query (TEXT(0)),b.skip (TEXT(0)),b.id (TEXT(0)),b.name
(TEXT(0)),b.keyword (TEXT(0)),?int8_0 (INT8(0))} and "Scan" : {"table":"eb_1381647894474_0002_000002",
  "out schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt
(TEXT(0)),a.id (TEXT(0))}
  "in schema": {a.vdate (TEXT(0)),a.vcol6 (TEXT(0)),a.col10 (TEXT(0)),a.col1 (TEXT(0)),a.pt
(TEXT(0)),a.id (TEXT(0))}
=======================================================
Block Id: eb_1381647894474_0002_000004 [TERMINAL]
=======================================================

2013-10-13 16:10:13,906 INFO  service.AbstractService (AbstractService.java:start(94)) - Service:org.apache.tajo.worker.AbstractResourceAllocator
is started.
2013-10-13 16:10:13,907 INFO  service.AbstractService (AbstractService.java:start(94)) - Service:org.apache.tajo.master.TajoAsyncDispatcher
is started.
2013-10-13 16:10:13,907 INFO  master.TajoAsyncDispatcher (TajoAsyncDispatcher.java:start(101))
- AsyncDispatcher started:q_1381647894474_0002
2013-10-13 16:10:13,907 INFO  service.AbstractService (AbstractService.java:start(94)) - Service:org.apache.tajo.master.querymaster.QueryMasterTask
is started.
2013-10-13 16:10:13,907 INFO  querymaster.Query (Query.java:handle(443)) - Processing q_1381647894474_0002
of type INIT
2013-10-13 16:10:13,908 INFO  querymaster.Query (Query.java:handle(457)) - q_1381647894474_0002
Query Transitioned from QUERY_NEW to QUERY_INIT
2013-10-13 16:10:13,908 INFO  querymaster.Query (Query.java:handle(443)) - Processing q_1381647894474_0002
of type START
2013-10-13 16:10:13,913 INFO  querymaster.SubQuery (SubQuery.java:calculatePartitionNum(506))
- Outer volume: 1.0
2013-10-13 16:10:13,913 INFO  querymaster.SubQuery (SubQuery.java:calculatePartitionNum(507))
- Inner volume: 3288.0
2013-10-13 16:10:13,913 INFO  querymaster.SubQuery (SubQuery.java:calculatePartitionNum(512))
- Smaller Table's volume is approximately 1 MB
2013-10-13 16:10:13,913 INFO  querymaster.SubQuery (SubQuery.java:calculatePartitionNum(516))
- The determined number of join partitions is 1
2013-10-13 16:10:13,924 INFO  storage.AbstractStorageManager (AbstractStorageManager.java:listStatus(377))
- Total input paths to process : 1
2013-10-13 16:10:13,964 INFO  storage.AbstractStorageManager (AbstractStorageManager.java:getSplits(593))
- Total # of splits: 1
2013-10-13 16:10:13,967 INFO  querymaster.SubQuery (SubQuery.java:createTasks(566)) - Create
1 Tasks
2013-10-13 16:10:13,970 INFO  service.AbstractService (AbstractService.java:init(81)) - Service:org.apache.tajo.master.TaskSchedulerImpl
is inited.
2013-10-13 16:10:13,970 INFO  event.TaskScheduleEvent (TaskSchedulerImpl.java:start(90)) -
Start TaskScheduler
2013-10-13 16:10:13,970 INFO  service.AbstractService (AbstractService.java:start(94)) - Service:org.apache.tajo.master.TaskSchedulerImpl
is started.
2013-10-13 16:10:13,978 INFO  querymaster.SubQuery (SubQuery.java:allocateContainers(620))
- Request Container for eb_1381647894474_0002_000001 containers=1
2013-10-13 16:10:13,983 INFO  querymaster.Query (Query.java:handle(457)) - q_1381647894474_0002
Query Transitioned from QUERY_INIT to QUERY_RUNNING
2013-10-13 16:10:13,983 INFO  worker.TajoResourceAllocator (TajoResourceAllocator.java:run(223))
- Start TajoWorkerAllocationThread
2013-10-13 16:10:13,987 INFO  worker.TajoResourceAllocator (TajoResourceAllocator.java:run(323))
- Stop TajoWorkerAllocationThread
2013-10-13 16:10:13,988 INFO  querymaster.SubQuery (SubQuery.java:transition(686)) - SubQuery
(eb_1381647894474_0002_000001) has 1 containers!
2013-10-13 16:10:13,990 INFO  master.ContainerProxy (TajoContainerProxy.java:launch(56)) -
Launch Container:eb_1381647894474_0002_000001,1,container_1381647894474_0002_01_000001,ceo-tajo05:8092,
pullServer=37687
2013-10-13 16:10:13,993 INFO  worker.TajoResourceAllocator (TajoResourceAllocator.java:run(182))
- ContainerProxy started:container_1381647894474_0002_01_000001
2013-10-13 16:10:13,996 INFO  querymaster.Query (Query.java:handle(443)) - Processing q_1381647894474_0002
of type INIT_COMPLETED
2013-10-13 16:10:14,003 INFO  event.TaskScheduleEvent (TaskSchedulerImpl.java:handle(232))
- TaskRequest: container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,148 ERROR querymaster.QueryUnitAttempt (QueryUnitAttempt.java:transition(312))
- FROM ceo-tajo05 >> java.lang.ArrayIndexOutOfBoundsException: 6
	at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
	at org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
	at org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
	at org.apache.tajo.worker.Task.run(Task.java:381)
	at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
	at java.lang.Thread.run(Thread.java:662)

2013-10-13 16:10:14,148 INFO  event.TaskScheduleEvent (TaskSchedulerImpl.java:handle(232))
- TaskRequest: container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,149 INFO  querymaster.QueryUnit (QueryUnit.java:transition(432)) - =============================================================
2013-10-13 16:10:14,149 INFO  querymaster.QueryUnit (QueryUnit.java:transition(433)) - >>>
Task Failed: ta_1381647894474_0002_000001_000000_00 <<<
2013-10-13 16:10:14,149 INFO  querymaster.QueryUnit (QueryUnit.java:transition(434)) - =============================================================
2013-10-13 16:10:14,209 ERROR querymaster.QueryUnitAttempt (QueryUnitAttempt.java:transition(312))
- FROM ceo-tajo05 >> java.lang.ArrayIndexOutOfBoundsException: 6
	at org.apache.tajo.storage.VTuple.get(VTuple.java:97)
	at org.apache.tajo.storage.CSVFile$CSVAppender.addTuple(CSVFile.java:172)
	at org.apache.tajo.engine.planner.physical.PartitionedStoreExec.next(PartitionedStoreExec.java:124)
	at org.apache.tajo.worker.Task.run(Task.java:381)
	at org.apache.tajo.worker.TaskRunner$2.run(TaskRunner.java:364)
	at java.lang.Thread.run(Thread.java:662)

2013-10-13 16:10:14,209 INFO  querymaster.QueryUnit (QueryUnit.java:transition(432)) - =============================================================
2013-10-13 16:10:14,209 INFO  querymaster.QueryUnit (QueryUnit.java:transition(433)) - >>>
Task Failed: ta_1381647894474_0002_000001_000000_01 <<<
2013-10-13 16:10:14,209 INFO  event.TaskScheduleEvent (TaskSchedulerImpl.java:handle(232))
- TaskRequest: container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,209 INFO  querymaster.QueryUnit (QueryUnit.java:transition(434)) - =============================================================
2013-10-13 16:10:14,320 ERROR querymaster.QueryUnitAttempt (QueryUnitAttempt.java:transition(312))
- FROM ceo-tajo05 >> java.lang.ArrayIndexOutOfBoundsException

2013-10-13 16:10:14,320 INFO  querymaster.QueryUnit (QueryUnit.java:transition(432)) - =============================================================
2013-10-13 16:10:14,320 INFO  querymaster.QueryUnit (QueryUnit.java:transition(433)) - >>>
Task Failed: ta_1381647894474_0002_000001_000000_02 <<<
2013-10-13 16:10:14,320 INFO  event.TaskScheduleEvent (TaskSchedulerImpl.java:handle(232))
- TaskRequest: container_1381647894474_0002_01_000001,eb_1381647894474_0002_000001
2013-10-13 16:10:14,320 INFO  querymaster.QueryUnit (QueryUnit.java:transition(434)) - =============================================================
2013-10-13 16:10:14,994 INFO  rpc.NettyClientBase (NettyClientBase.java:close(87)) - Proxy
is disconnected from 50.1.102.126:8092
{code}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message