tajo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinho Kim <jino...@gmail.com>
Subject Re: endless query execution
Date Thu, 21 Aug 2014 02:45:51 GMT
Hello Chris,

Sounds great!. we will update the documents.
Thank you!

--Jinho
Best regards


2014-08-21 2:45 GMT+09:00 Christian Schwabe <Christian.Schwabe@gmx.com>:
> Hello Jinho,
>
> christians-mbp:bin chris$ netstat -a | grep 49339
> tcp46      0      0  *.49339                *.*                    LISTEN
>
> tajo-chris-worker-xxx.out is completely empty. No errors in it.
>
> I recompile Tajo with mvn clean install -Pdist -DskipTests -Dtar
> -Dhadoop.version=2.4.0
>
>
> AND
>
>
>
>
>
>
> IT WORKS!!! Yiiipie aye jeah!!! :-D :-D
>
>
> The error must have been so, since it worked for a short time that I've
> recompiled wrong according to the pull request from git and have
> -Dhadoop.version = 2.4.0 forgotten. Sorry for these newbie mistakes.
> I am so glad that we did it together that it works now. I can only hope that
> we have helped others with it who have made the same mistake as I did.
> Thank you very much.
>
>
> Best regards,
> Chris
>
>
> Am 20.08.2014 um 15:45 schrieb Jinho Kim <jinossy@gmail.com>:
>
> Hello Chris,
>
> Sorry chris, I mistook your environment.
> try again following command 'netstat -a | grep <shuffle port>'
> looks like build issue. could you find error log in
> tajo-chris-worker-xxx.out ?
>
> Did you build the tajo following command ?
> mvn clean install -Pdist -DskipTests -Dtar -Dhadoop.version=2.4.0 //
> your hadoop version
> https://github.com/apache/tajo/blob/master/BUILDING
>
> --Jinho
> Best regards
>
>
> 2014-08-20 21:08 GMT+09:00 Christian Schwabe <Christian.Schwabe@gmx.com>:
>
> Hello Hyunsik and Jinho
>
> Thank you for your continued efforts.
> Cluster organization:
> Tajo Master and Tajo Worker run on my MacBook. No Distribution.
>
> For this test the TajoPullServerService shuffle on Port 54783:
> 2014-08-20 13:37:48,727 INFO
> org.apache.tajo.pullserver.TajoPullServerService: httpshuffle listening on
> port 54783
>
>
> Here a full dump from my netstat:
>
> christians-mbp:bin chris$ netstat
> Active Internet connections
> Proto Recv-Q Send-Q  Local Address          Foreign Address        (state)
> tcp4       0      0  christians-mbp.f.28093 christians-mbp.f.54813
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54813 christians-mbp.f.28093
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.28091 christians-mbp.f.54812
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54812 christians-mbp.f.28091
> ESTABLISHED
> tcp4       0      0  localhost.26001        localhost.54811
> ESTABLISHED
> tcp4       0      0  localhost.54811        localhost.26001
> ESTABLISHED
> tcp4       0      0  localhost.26005        localhost.54810
> ESTABLISHED
> tcp4       0      0  localhost.54810        localhost.26005
> ESTABLISHED
> tcp4       0      0  localhost.26002        localhost.54806
> ESTABLISHED
> tcp4       0      0  localhost.54806        localhost.26002
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54799 professional.nl..http
> CLOSE_WAIT
> tcp4       0      0  localhost.26003        localhost.54784
> ESTABLISHED
> tcp4       0      0  localhost.54784        localhost.26003
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54163 snt-re4-9c.sjc.d.http
> ESTABLISHED
> tcp4       0     39  christians-mbp.f.54143 diskstation.frit.afpov
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54101 channel-proxy-sh.https
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54102 channel-proxy-sh.https
> ESTABLISHED
> tcp4      23      0  christians-mbp.f.54100 diskstation.frit.6690
> CLOSE_WAIT
> tcp4      23      0  christians-mbp.f.54058 diskstation.frit.6690
> CLOSE_WAIT
> tcp4       0      0  christians-mbp.f.54057 diskstation.frit.6690
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.54055 diskstation.frit.6690
> ESTABLISHED
> tcp4      23      0  christians-mbp.f.54051 diskstation.frit.6690
> CLOSE_WAIT
> tcp4       0      0  christians-mbp.f.54029 server22404.team.5938
> ESTABLISHED
> tcp4     207      0  christians-mbp.f.53391 channel-proxy-sh.https
> CLOSE_WAIT
> tcp4       0      0  christians-mbp.f.52913 mailgate-fb.its..imaps
> CLOSE_WAIT
> tcp4       0      0  christians-mbp.f.52637 lon3-accesspoint.4070
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52619 channel-proxy-sh.https
> FIN_WAIT_2
> tcp4       0      0  christians-mbp.f.52591 mailgate-fb.its..imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52557 imap.gmx.net.imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52545 imap.gmx.net.imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52542 mailgate-fb.its..imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52534 imap.gmx.net.imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52524 mailgate-fb.its..imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.52523 imap.gmx.net.imaps
> ESTABLISHED
> tcp4       0      0  christians-mbp.f.60387 17.130.254.13.5223
> ESTABLISHED
> tcp4       0      0  localhost.26164        localhost.50911
> ESTABLISHED
> tcp4       0      0  localhost.50911        localhost.26164
> ESTABLISHED
> tcp4      37      0  christians-mbp.f.62717 bighp.de.https
> CLOSE_WAIT
> tcp4       0      0  localhost.6263         localhost.51436
> ESTABLISHED
> tcp4       0      0  localhost.51436        localhost.6263
> ESTABLISHED
> tcp4       0      0  localhost.49153        localhost.1023
> ESTABLISHED
> tcp4       0      0  localhost.1023         localhost.49153
> ESTABLISHED
> udp4       0      0  localhost.ipsec-msft   *.*
> udp4       0      0  localhost.isakmp       *.*
> udp4       0      0  localhost.ipsec-msft   *.*
> udp4       0      0  localhost.isakmp       *.*
> udp4       0      0  localhost.ntp          *.*
> udp4       0      0  localhost.ntp          *.*
> udp6       0      0  *.57515                *.*
> udp4       0      0  *.57515                *.*
> udp6       0      0  *.61888                *.*
> udp4       0      0  *.61888                *.*
> udp6       0      0  *.58274                *.*
> udp4       0      0  *.58274                *.*
> udp6       0      0  *.60021                *.*
> udp4       0      0  *.60021                *.*
> udp6       0      0  *.55834                *.*
> udp4       0      0  *.55834                *.*
> udp6       0      0  *.50669                *.*
> udp4       0      0  *.50669                *.*
> udp4       0      0  *.57621                *.*
> udp4       0      0  *.17500                *.*
> udp6       0      0  *.52359                *.*
> udp4       0      0  *.52359                *.*
> udp6       0      0  *.61162                *.*
> udp4       0      0  *.61162                *.*
> udp6       0      0  *.64994                *.*
> udp4       0      0  *.64994                *.*
> udp6       0      0  *.52746                *.*
> udp4       0      0  *.52746                *.*
> udp6       0      0  *.52452                *.*
> udp4       0      0  *.52452                *.*
> udp6       0      0  *.56102                *.*
> udp4       0      0  *.56102                *.*
> udp46      0      0  *.*                    *.*
> udp4       0      0  all-systems.mcas.5350  *.*
> udp4       0      0  christians-mbp.f.ipsec *.*
> udp4       0      0  christians-mbp.f.isakm *.*
> udp6       0      0  christians-macbo.ipsec *.*
> udp6       0      0  christians-macbo.isakm *.*
> udp4       0      0  christians-mbp.f.ntp   *.*
> udp46      0      0  *.*                    *.*
> udp6       0      0  christians-macbo.ntp   *.*
> udp46      0      0  *.*                    *.*
> udp46      0      0  *.*                    *.*
> udp46      0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp6       0      0  fd87:142d:29d4:9.ipsec *.*
> udp6       0      0  fd87:142d:29d4:9.isakm *.*
> udp6       0      0  fd87:142d:29d4:9.ntp   *.*
> udp6       0      0  fe80::6c2f:2fc4:.ntp   *.*
> udp6       0      0  localhost.ipsec-ms     *.*
> udp6       0      0  localhost.isakmp       *.*
> udp4       0      0  localhost.ipsec-msft   *.*
> udp4       0      0  localhost.isakmp       *.*
> udp6       0      0  localhost.ipsec-ms     *.*
> udp6       0      0  localhost.isakmp       *.*
> udp6       0      0  fe80::6c2f:2fc4:.ipsec *.*
> udp6       0      0  fe80::6c2f:2fc4:.isakm *.*
> udp6       0      0  localhost.ntp          *.*
> udp4       0      0  localhost.ntp          *.*
> udp6       0      0  localhost.ntp          *.*
> udp6       0      0  *.ntp                  *.*
> udp4       0      0  *.ntp                  *.*
> udp46      0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp46      0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp6       0      0  *.mdns                 *.*
> udp4       0      0  *.mdns                 *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.*                    *.*
> udp4       0      0  *.netbios-dgm          *.*
> udp4       0      0  *.netbios-ns           *.*
> icm4       0      0  *.*                    *.*
> icm6       0      0  *.*                    *.*
>
>
> As you can see no service is running on the previously established Port.
> In summary this means, according to the log of the Service
> TajoPullServerService the port is listening, but according to netstat no
> such port ist open.
> My Firewall was turned off for this test. There was no improvement.
>
>
>
> For addition:
> The exception is only thrown if i made the following statement.
>
> default> SELECT COUNT(*) FROM table1;
> Progress: 0%, response time: 0.8 sec
> Progress: 0%, response time: 0.807 sec
> Progress: 0%, response time: 1.012 sec
> Progress: 50%, response time: 1.413 sec
> ERROR: 1
> java.lang.ArrayIndexOutOfBoundsException: 1
> at org.apache.tajo.util.BitArray.fromByteBuffer(BitArray.java:84)
> at org.apache.tajo.storage.RawFile$RawFileScanner.next(RawFile.java:243)
> at
> org.apache.tajo.engine.planner.physical.SeqScanExec.next(SeqScanExec.java:254)
> at
> org.apache.tajo.engine.planner.physical.HashAggregateExec.compute(HashAggregateExec.java:51)
> at
> org.apache.tajo.engine.planner.physical.HashAggregateExec.next(HashAggregateExec.java:87)
> at
> org.apache.tajo.engine.planner.physical.StoreTableExec.next(StoreTableExec.java:77)
> at org.apache.tajo.worker.Task.run(Task.java:425)
> at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:425)
> at java.lang.Thread.run(Thread.java:745)
>
> SELECT * FROM table1; is no problem.
>
> default> SELECT * FROM table1;
> id,  name,  score,  type
> -------------------------------
> 1,  abc,  1.1,  a
> 2,  def,  2.3,  b
> 3,  ghi,  3.4,  c
> 4,  jkl,  4.5,  d
> 5,  mno,  5.6,  e
> (5 rows, 0.955 sec, 59 B selected)
>
>
>
> If you need any further information don’t hesitate to ask.
>
>
>
> @@Jinho: I don’t know exactly what you mean with: stop iptables????
>
> Best regards,
> Chris
>
>
>
>
>

Mime
View raw message