kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaofeng SHI (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0
Date Tue, 28 Aug 2018 01:41:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594392#comment-16594392
] 

Shaofeng SHI commented on KYLIN-3518:
-------------------------------------

Table description:

 

hbase(main):001:0> describe 'KYLIN_5Q088VO5I0'
Table KYLIN_5Q088VO5I0 is ENABLED
KYLIN_5Q088VO5I0, {TABLE_ATTRIBUTES => {coprocessor$1 => 'hdfs://ignite01.com:8020/kylin/kylin_metadata/coprocessor/kylin-coprocessor-2.5.0-SNAPSHOT-0.jar|org.apache.kylin.storage.hbase.cube.v2.coproces
sor.endpoint.CubeVisitService|1001|', METADATA => {'CREATION_TIME' => '1535417272290',
'GIT_COMMIT' => 'a83133ad565a98cf90ce8d2cf603ecbf8e96a3b0;', 'KYLIN_HOST' => 'kylin_metadata',
'OWNER' => 'whoami@k
ylin.apache.org', 'SEGMENT' => 'kylin_sales_cube_clone[20120101000000_20130101000000]',
'SPLIT_POLICY' => 'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy', 'USER'
=> 'ADMIN'}}
COLUMN FAMILIES DESCRIPTION
{NAME => 'F1', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR
=> 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING
=> 'FAST_DIFF', TTL
=> 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'NONE',
CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false',
PREFETCH_BLOCKS_ON_OPEN => 'f
alse', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}
1 row(s)

> Coprocessor reports NPE when execute a query on HBase 2.0
> ---------------------------------------------------------
>
>                 Key: KYLIN-3518
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3518
>             Project: Kylin
>          Issue Type: Bug
>          Components: Storage - HBase
>            Reporter: Shaofeng SHI
>            Priority: Major
>
> On HDP 3.0, build a cube and then run a simple count query, NPE occurred:
>  
> {code:java}
> 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] v2.CubeHBaseRPC:315
: hbase.rpc.timeout = 90000 ms, use 81000 ms as timeout for coprocessor
> 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] v2.CubeHBaseEndpointRPC:141
: Serialized scanRequestBytes 522 bytes, rawScanBytesString 44 bytes
> 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] v2.CubeHBaseEndpointRPC:143
: The scan 67b41fc6 for segment kylin_sales_cube_clone[20120101000000_20130101000000] is as
below with 1 separate raw scans, shard part of start/end key is set to 0
> 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] v2.CubeHBaseRPC:288
: Visiting hbase table KYLIN_5Q088VO5I0: cuboid require post aggregation, from 0 to 16384
Start: \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00)
Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00),
No Fuzzy Key
> 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] v2.CubeHBaseEndpointRPC:148
: Submitting rpc to 1 shards starting from shard 0, scan range count 1
> 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] common.KylinConfig:332
: Loading kylin-defaults.properties from file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties
> 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] common.KylinConfig:291
: KYLIN_CONF property was not set, will seek KYLIN_HOME env variable
> 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 : Creating
coprocessor thread pool with max of 2048, core of 2048
> 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] gtrecord.SequentialCubeTupleIterator:73
: Using SortedIteratorMergerWithLimit to merge segment results
> 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] enumerator.OLAPEnumerator:117
: return TupleIterator...
> 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1] client.RpcRetryingCallerImpl:134
: Call exception, tries=6, retries=6, started=4410 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> , details=row '' on table 'KYLIN_5Q088VO5I0' at region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692.,
hostname=ignite03.com,16020,1534313612401, seqNum=2
> 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1] client.RpcRetryingCallerImpl:134
: Call exception, tries=7, retries=7, started=8436 ms ago, cancelled=false, msg=java.io.IOException
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> Caused by: java.lang.NullPointerException
> at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253)
> at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
> at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426)
> at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408)
> at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)
> ... 3 more
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message