Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D5DE1200B28 for ; Sun, 26 Jun 2016 13:55:17 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D454D160A5C; Sun, 26 Jun 2016 11:55:17 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D1DF4160A28 for ; Sun, 26 Jun 2016 13:55:16 +0200 (CEST) Received: (qmail 17352 invoked by uid 500); 26 Jun 2016 11:55:15 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 17343 invoked by uid 99); 26 Jun 2016 11:55:15 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 26 Jun 2016 11:55:15 +0000 Received: from mail-qk0-f171.google.com (mail-qk0-f171.google.com [209.85.220.171]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 50A371A0044 for ; Sun, 26 Jun 2016 11:55:15 +0000 (UTC) Received: by mail-qk0-f171.google.com with SMTP id n81so4779133qke.2 for ; Sun, 26 Jun 2016 04:55:15 -0700 (PDT) X-Gm-Message-State: ALyK8tKdPv0vCFF9FUKaUor4zFOqbA2N0YxjXD8DHAYHB/xtaPEc2VTeC/xJHA62tlXwpQM7RaiWBZ1Cy/STXQ== X-Received: by 10.55.43.229 with SMTP id r98mr16764988qkr.62.1466942114355; Sun, 26 Jun 2016 04:55:14 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.145.7 with HTTP; Sun, 26 Jun 2016 04:55:13 -0700 (PDT) In-Reply-To: References: <2994F254A682DA469C4A75BDABFF91544CB81D@IT-EXMB-16-29.meizu.com> From: Li Yang Date: Sun, 26 Jun 2016 19:55:13 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: query to slow ................... To: user@kylin.apache.org Content-Type: multipart/alternative; boundary=001a11493f96a1fd3b05362d130a archived-at: Sun, 26 Jun 2016 11:55:18 -0000 --001a11493f96a1fd3b05362d130a Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Troubleshooting slow query is not easy. Need to understand the data model, the cube definition, and the exact query. Start from 1.5.2.1, Kylin has a diagnosis tool that let you export necessary info in one zip. May help the communication. On Sat, Jun 18, 2016 at 9:41 AM, ShaoFeng Shi wrote: > Hi Tianshuo, > > We welcome user to raise questions in the mailing list and we'd like to > help as much as we can; but there are still some practices regarding how = to > ask a question; Here is a good article, I strongly recommend that you rea= d > it: > > http://catb.org/~esr/faqs/smart-questions.html#beprecise > > > 2016-06-17 19:01 GMT+08:00 =E8=B5=B5=E5=A4=A9=E7=83=81 : > >> after successfully build a cube and send a query, it just stuck in >> executing=E2=80=A6 phase ,then after a while ,I got error log as follow= : >> >> 2016-06-17 18:57:45,671 DEBUG [BadQueryDetector] >> hbase.HBaseResourceStore:262 : Update row /bad_query/learn_kylin.json fr= om >> oldTs: 1466161005652, to newTs: 1466161065665, operation result: true >> >> 2016-06-17 18:57:45,672 INFO [BadQueryDetector] >> service.BadQueryDetector:230 : Problematic thread 0x63 >> >> at sun.misc.Unsafe.park(Native Method) >> >> at >> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) >> >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.aw= aitNanos(AbstractQueuedSynchronizer.java:2082) >> >> at >> java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389= ) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSize= Iterator.next(CubeHBaseEndpointRPC.java:125) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSize= Iterator.next(CubeHBaseEndpointRPC.java:81) >> >> at >> com.google.common.collect.TransformedIterator.next(TransformedIterator.j= ava:48) >> >> at >> com.google.common.collect.Iterators$6.hasNext(Iterators.java:583) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNe= xt(SequentialCubeTupleIterator.java:96) >> >> at >> org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator= .java:74) >> >> >> >> 2016-06-17 18:57:45,673 INFO [BadQueryDetector] >> service.BadQueryDetector:104 : Slow query has been running 3079.402 seco= nds >> (project:learn_kylin, thread: 0x61) -- select * from KYLIN_SALES >> >> 2016-06-17 18:57:45,676 DEBUG [BadQueryDetector] >> badquery.BadQueryHistoryManager:84 : Loaded 5 Bad Query(s) >> >> 2016-06-17 18:57:45,681 DEBUG [BadQueryDetector] >> hbase.HBaseResourceStore:262 : Update row /bad_query/learn_kylin.json fr= om >> oldTs: 1466161065665, to newTs: 1466161065676, operation result: true >> >> 2016-06-17 18:57:45,682 INFO [BadQueryDetector] >> service.BadQueryDetector:230 : Problematic thread 0x61 >> >> at sun.misc.Unsafe.park(Native Method) >> >> at >> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) >> >> at >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.aw= aitNanos(AbstractQueuedSynchronizer.java:2082) >> >> at >> java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389= ) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSize= Iterator.next(CubeHBaseEndpointRPC.java:125) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSize= Iterator.next(CubeHBaseEndpointRPC.java:81) >> >> at >> com.google.common.collect.TransformedIterator.next(TransformedIterator.j= ava:48) >> >> at >> com.google.common.collect.Iterators$6.hasNext(Iterators.java:583) >> >> at >> org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNe= xt(SequentialCubeTupleIterator.java:96) >> >> at >> org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator= .java:74) >> >> >> >> 2016-06-17 18:57:45,682 INFO [BadQueryDetector] >> service.BadQueryDetector:104 : Slow query has been running 2989.567 seco= nds >> (project:learn_kylin, thread: 0x8bd) -- select * from KYLIN_SALES limit = 1; >> >> 2016-06-17 18:57:45,685 DEBUG [BadQueryDetector] >> badquery.BadQueryHistoryManager:84 : Loaded 5 Bad Query(s) >> >> 2016-06-17 18:57:45,690 DEBUG [BadQueryDetector] >> hbase.HBaseResourceStore:262 : Update row /bad_query/learn_kylin.json fr= om >> oldTs: 1466161065676, to newTs: 1466161065686, operation result: true >> >> 2016-06-17 18:57:45,692 INFO [BadQueryDetector] >> service.BadQueryDetector:230 : Problematic thread 0x8bd >> >> >> >> >> Any idea? >> >> ----------------------------------------------------- >> >> >> >> =E8=B5=B5=E5=A4=A9=E7=83=81 >> >> Kevin Zhao >> >> *zhaotianshuo@meizu.com * >> >> >> >> =E7=8F=A0=E6=B5=B7=E5=B8=82=E9=AD=85=E6=97=8F=E7=A7=91=E6=8A=80=E6=9C=89= =E9=99=90=E5=85=AC=E5=8F=B8 >> >> MEIZU Technology Co., Ltd. >> >> =E5=B9=BF=E4=B8=9C=E7=9C=81=E7=8F=A0=E6=B5=B7=E5=B8=82=E7=A7=91=E6=8A=80= =E5=88=9B=E6=96=B0=E6=B5=B7=E5=B2=B8=E9=AD=85=E6=97=8F=E7=A7=91=E6=8A=80=E6= =A5=BC >> >> MEIZU Tech Bldg., Technology & Innovation Coast >> >> Zhuhai, 519085, Guangdong, China >> >> >> >> >> >> meizu.com >> >> >> >> >> >> >> >> >> > > > > -- > Best regards, > > Shaofeng Shi > > --001a11493f96a1fd3b05362d130a Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Troubleshooting slow query is not easy. Need to understand= the data model, the cube definition, and the exact query. Start from 1.5.2= .1, Kylin has a diagnosis tool that let you export necessary info in one zi= p. May help the communication.

On Sat, Jun 18, 2016 at 9:41 AM, ShaoFeng Shi <shaofengshi@apache.org> wrote:
Hi Tianshuo,

We welcome user to ra= ise questions in the mailing list and we'd like to help as much as we c= an; but there are still some practices regarding how to ask a question; Her= e is a good article, I strongly recommend that you read it: =C2=A0



2016-06-17 19:01 GMT+08:= 00 =E8=B5=B5=E5=A4=A9=E7=83=81 <zhaotianshuo@meizu.com>= :

after successfully build a cube= and send a query, it just stuck in executing=E2=80=A6 =C2=A0phase ,then af= ter a while ,I got error log as follow:

2016-06-17 18:57:45,671 DEBUG [= BadQueryDetector] hbase.HBaseResourceStore:262 : Update row /bad_query/lear= n_kylin.json from oldTs: 1466161005652, to newTs: 1466161065665, operation = result: true

2016-06-17 18:57:45,672 INFO=C2= =A0 [BadQueryDetector] service.BadQueryDetector:230 : Problematic thread 0x= 63

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at sun.misc.Unsafe.park(Native Method)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.locks.LockSupport.parkNanos(LockSuppor= t.java:226)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.locks.AbstractQueuedSynchronizer$Condi= tionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQ= ueue.java:389)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC= $ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:125)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC= $ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:81)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at com.google.common.collect.TransformedIterator.next(Transfor= medIterator.java:48)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at com.google.common.collect.Iterators$6.hasNext(Iterators.jav= a:583)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleI= terator.hasNext(SequentialCubeTupleIterator.java:96)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(O= LAPEnumerator.java:74)

=C2=A0

2016-06-17 18:57:45,673 INFO=C2= =A0 [BadQueryDetector] service.BadQueryDetector:104 : Slow query has been r= unning 3079.402 seconds (project:learn_kylin, thread: 0x61) -- select * fro= m KYLIN_SALES

2016-06-17 18:57:45,676 DEBUG [= BadQueryDetector] badquery.BadQueryHistoryManager:84 : Loaded 5 Bad Query(s= )

2016-06-17 18:57:45,681 DEBUG [= BadQueryDetector] hbase.HBaseResourceStore:262 : Update row /bad_query/lear= n_kylin.json from oldTs: 1466161065665, to newTs: 1466161065676, operation = result: true

2016-06-17 18:57:45,682 INFO=C2= =A0 [BadQueryDetector] service.BadQueryDetector:230 : Problematic thread 0x= 61

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at sun.misc.Unsafe.park(Native Method)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.locks.LockSupport.parkNanos(LockSuppor= t.java:226)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.locks.AbstractQueuedSynchronizer$Condi= tionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQ= ueue.java:389)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC= $ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:125)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC= $ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:81)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at com.google.common.collect.TransformedIterator.next(Transfor= medIterator.java:48)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at com.google.common.collect.Iterators$6.hasNext(Iterators.jav= a:583)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleI= terator.hasNext(SequentialCubeTupleIterator.java:96)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(O= LAPEnumerator.java:74)

=C2=A0

2016-06-17 18:57:45,682 INFO=C2= =A0 [BadQueryDetector] service.BadQueryDetector:104 : Slow query has been r= unning 2989.567 seconds (project:learn_kylin, thread: 0x8bd) -- select * fr= om KYLIN_SALES limit 1;

2016-06-17 18:57:45,685 DEBUG [= BadQueryDetector] badquery.BadQueryHistoryManager:84 : Loaded 5 Bad Query(s= )

2016-06-17 18:57:45,690 DEBUG [= BadQueryDetector] hbase.HBaseResourceStore:262 : Update row /bad_query/lear= n_kylin.json from oldTs: 1466161065676, to newTs: 1466161065686, operation = result: true

2016-06-17 18:57:45,692 INFO=C2= =A0 [BadQueryDetector] service.BadQueryDetector:230 : Problematic thread 0x= 8bd

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0

Any idea?<= /p>

----------------------------------------------= -------

=C2=A0

=E8=B5=B5=E5=A4=A9=E7=83=81

Kevin Zhao

zhaotianshuo@meizu.com<= /span>

=C2=A0

=E7=8F=A0=E6=B5=B7=E5=B8= =82=E9=AD=85=E6=97=8F=E7=A7=91=E6=8A=80=E6=9C=89=E9=99=90=E5=85=AC=E5=8F=B8=

MEIZU Technology Co., Ltd.

=E5=B9=BF=E4=B8=9C=E7=9C= =81=E7=8F=A0=E6=B5=B7=E5=B8=82=E7=A7=91=E6=8A=80=E5=88=9B=E6=96=B0=E6=B5=B7= =E5=B2=B8=E9=AD=85=E6=97=8F=E7=A7=91=E6=8A=80=E6=A5=BC=

MEIZU Tech Bldg., Technology & Innovation = Coast

Zhuhai, 519085, Guangdong, China=

=C2=A0

=C2=A0

meizu.com

=C2=A0

=C2=A0

=C2=A0

=C2=A0




--
Best regards,

Shaofeng Shi<= /div>


--001a11493f96a1fd3b05362d130a--