tajo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christian Schwabe <Christian.Schw...@gmx.com>
Subject endless query execution
Date Wed, 20 Aug 2014 12:08:10 GMT
Hello Hyunsik and Jinho

Thank you for your continued efforts.
Cluster organization:
Tajo Master and Tajo Worker run on my MacBook. No Distribution.

For this test the TajoPullServerService shuffle on Port 54783:
2014-08-20 13:37:48,727 INFO org.apache.tajo.pullserver.TajoPullServerService: httpshuffle
listening on port 54783


Here a full dump from my netstat:

christians-mbp:bin chris$ netstat
Active Internet connections
Proto Recv-Q Send-Q  Local Address          Foreign Address        (state)    
tcp4       0      0  christians-mbp.f.28093 christians-mbp.f.54813 ESTABLISHED
tcp4       0      0  christians-mbp.f.54813 christians-mbp.f.28093 ESTABLISHED
tcp4       0      0  christians-mbp.f.28091 christians-mbp.f.54812 ESTABLISHED
tcp4       0      0  christians-mbp.f.54812 christians-mbp.f.28091 ESTABLISHED
tcp4       0      0  localhost.26001        localhost.54811        ESTABLISHED
tcp4       0      0  localhost.54811        localhost.26001        ESTABLISHED
tcp4       0      0  localhost.26005        localhost.54810        ESTABLISHED
tcp4       0      0  localhost.54810        localhost.26005        ESTABLISHED
tcp4       0      0  localhost.26002        localhost.54806        ESTABLISHED
tcp4       0      0  localhost.54806        localhost.26002        ESTABLISHED
tcp4       0      0  christians-mbp.f.54799 professional.nl..http  CLOSE_WAIT 
tcp4       0      0  localhost.26003        localhost.54784        ESTABLISHED
tcp4       0      0  localhost.54784        localhost.26003        ESTABLISHED
tcp4       0      0  christians-mbp.f.54163 snt-re4-9c.sjc.d.http  ESTABLISHED
tcp4       0     39  christians-mbp.f.54143 diskstation.frit.afpov ESTABLISHED
tcp4       0      0  christians-mbp.f.54101 channel-proxy-sh.https ESTABLISHED
tcp4       0      0  christians-mbp.f.54102 channel-proxy-sh.https ESTABLISHED
tcp4      23      0  christians-mbp.f.54100 diskstation.frit.6690  CLOSE_WAIT 
tcp4      23      0  christians-mbp.f.54058 diskstation.frit.6690  CLOSE_WAIT 
tcp4       0      0  christians-mbp.f.54057 diskstation.frit.6690  ESTABLISHED
tcp4       0      0  christians-mbp.f.54055 diskstation.frit.6690  ESTABLISHED
tcp4      23      0  christians-mbp.f.54051 diskstation.frit.6690  CLOSE_WAIT 
tcp4       0      0  christians-mbp.f.54029 server22404.team.5938  ESTABLISHED
tcp4     207      0  christians-mbp.f.53391 channel-proxy-sh.https CLOSE_WAIT 
tcp4       0      0  christians-mbp.f.52913 mailgate-fb.its..imaps CLOSE_WAIT 
tcp4       0      0  christians-mbp.f.52637 lon3-accesspoint.4070  ESTABLISHED
tcp4       0      0  christians-mbp.f.52619 channel-proxy-sh.https FIN_WAIT_2 
tcp4       0      0  christians-mbp.f.52591 mailgate-fb.its..imaps ESTABLISHED
tcp4       0      0  christians-mbp.f.52557 imap.gmx.net.imaps     ESTABLISHED
tcp4       0      0  christians-mbp.f.52545 imap.gmx.net.imaps     ESTABLISHED
tcp4       0      0  christians-mbp.f.52542 mailgate-fb.its..imaps ESTABLISHED
tcp4       0      0  christians-mbp.f.52534 imap.gmx.net.imaps     ESTABLISHED
tcp4       0      0  christians-mbp.f.52524 mailgate-fb.its..imaps ESTABLISHED
tcp4       0      0  christians-mbp.f.52523 imap.gmx.net.imaps     ESTABLISHED
tcp4       0      0  christians-mbp.f.60387 17.130.254.13.5223     ESTABLISHED
tcp4       0      0  localhost.26164        localhost.50911        ESTABLISHED
tcp4       0      0  localhost.50911        localhost.26164        ESTABLISHED
tcp4      37      0  christians-mbp.f.62717 bighp.de.https         CLOSE_WAIT 
tcp4       0      0  localhost.6263         localhost.51436        ESTABLISHED
tcp4       0      0  localhost.51436        localhost.6263         ESTABLISHED
tcp4       0      0  localhost.49153        localhost.1023         ESTABLISHED
tcp4       0      0  localhost.1023         localhost.49153        ESTABLISHED
udp4       0      0  localhost.ipsec-msft   *.*                               
udp4       0      0  localhost.isakmp       *.*                               
udp4       0      0  localhost.ipsec-msft   *.*                               
udp4       0      0  localhost.isakmp       *.*                               
udp4       0      0  localhost.ntp          *.*                               
udp4       0      0  localhost.ntp          *.*                               
udp6       0      0  *.57515                *.*                               
udp4       0      0  *.57515                *.*                               
udp6       0      0  *.61888                *.*                               
udp4       0      0  *.61888                *.*                               
udp6       0      0  *.58274                *.*                               
udp4       0      0  *.58274                *.*                               
udp6       0      0  *.60021                *.*                               
udp4       0      0  *.60021                *.*                               
udp6       0      0  *.55834                *.*                               
udp4       0      0  *.55834                *.*                               
udp6       0      0  *.50669                *.*                               
udp4       0      0  *.50669                *.*                               
udp4       0      0  *.57621                *.*                               
udp4       0      0  *.17500                *.*                               
udp6       0      0  *.52359                *.*                               
udp4       0      0  *.52359                *.*                               
udp6       0      0  *.61162                *.*                               
udp4       0      0  *.61162                *.*                               
udp6       0      0  *.64994                *.*                               
udp4       0      0  *.64994                *.*                               
udp6       0      0  *.52746                *.*                               
udp4       0      0  *.52746                *.*                               
udp6       0      0  *.52452                *.*                               
udp4       0      0  *.52452                *.*                               
udp6       0      0  *.56102                *.*                               
udp4       0      0  *.56102                *.*                               
udp46      0      0  *.*                    *.*                               
udp4       0      0  all-systems.mcas.5350  *.*                               
udp4       0      0  christians-mbp.f.ipsec *.*                               
udp4       0      0  christians-mbp.f.isakm *.*                               
udp6       0      0  christians-macbo.ipsec *.*                               
udp6       0      0  christians-macbo.isakm *.*                               
udp4       0      0  christians-mbp.f.ntp   *.*                               
udp46      0      0  *.*                    *.*                               
udp6       0      0  christians-macbo.ntp   *.*                               
udp46      0      0  *.*                    *.*                               
udp46      0      0  *.*                    *.*                               
udp46      0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp6       0      0  fd87:142d:29d4:9.ipsec *.*                               
udp6       0      0  fd87:142d:29d4:9.isakm *.*                               
udp6       0      0  fd87:142d:29d4:9.ntp   *.*                               
udp6       0      0  fe80::6c2f:2fc4:.ntp   *.*                               
udp6       0      0  localhost.ipsec-ms     *.*                               
udp6       0      0  localhost.isakmp       *.*                               
udp4       0      0  localhost.ipsec-msft   *.*                               
udp4       0      0  localhost.isakmp       *.*                               
udp6       0      0  localhost.ipsec-ms     *.*                               
udp6       0      0  localhost.isakmp       *.*                               
udp6       0      0  fe80::6c2f:2fc4:.ipsec *.*                               
udp6       0      0  fe80::6c2f:2fc4:.isakm *.*                               
udp6       0      0  localhost.ntp          *.*                               
udp4       0      0  localhost.ntp          *.*                               
udp6       0      0  localhost.ntp          *.*                               
udp6       0      0  *.ntp                  *.*                               
udp4       0      0  *.ntp                  *.*                               
udp46      0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp46      0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp6       0      0  *.mdns                 *.*                               
udp4       0      0  *.mdns                 *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.*                    *.*                               
udp4       0      0  *.netbios-dgm          *.*                               
udp4       0      0  *.netbios-ns           *.*                               
icm4       0      0  *.*                    *.*                               
icm6       0      0  *.*                    *.*


As you can see no service is running on the previously established Port.
In summary this means, according to the log of the Service TajoPullServerService the port
is listening, but according to netstat no such port ist open.
My Firewall was turned off for this test. There was no improvement.



For addition:
The exception is only thrown if i made the following statement.

default> SELECT COUNT(*) FROM table1;
Progress: 0%, response time: 0.8 sec
Progress: 0%, response time: 0.807 sec
Progress: 0%, response time: 1.012 sec
Progress: 50%, response time: 1.413 sec
ERROR: 1
java.lang.ArrayIndexOutOfBoundsException: 1
	at org.apache.tajo.util.BitArray.fromByteBuffer(BitArray.java:84)
	at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:243)
	at org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:254)
	at org.apache.tajo.engine.planner.physical.HashAggregateExec.compute(HashAggregateExec.java:51)
	at org.apache.tajo.engine.planner.physical.HashAggregateExec.next(HashAggregateExec.java:87)
	at org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:77)
	at org.apache.tajo.worker.Task.run(Task.java:425)
	at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:425)
	at java.lang.Thread.run(Thread.java:745)

SELECT * FROM table1; is no problem.

default> SELECT * FROM table1;
id,  name,  score,  type
-------------------------------
1,  abc,  1.1,  a
2,  def,  2.3,  b
3,  ghi,  3.4,  c
4,  jkl,  4.5,  d
5,  mno,  5.6,  e
(5 rows, 0.955 sec, 59 B selected)



If you need any further information don’t hesitate to ask.



@@Jinho: I don’t know exactly what you mean with: stop iptables????

Best regards,
Chris


Mime
View raw message