kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 沈鲁威 <jingt...@dianjia.io>
Subject 紧急求救,kylin Query机 查询运行20多分钟后死机
Date Mon, 23 Apr 2018 14:51:49 GMT
各位大神:
我们这边搭建了 cdh5.13.1+kylin.2.3.0
一台任务机,三台查询机slb 负载均衡(4核8G)



问题:工作的过程中经常隔断时间,某一台查询机器查询报超时,紧接着所有查询均不可用
 只能kylin.sh stop 停掉这台查询机,其他机器才能正常工作

查看机器负载 并不高
查看日志 出现过的错误日志
1、ncategorized SQLException for SQL []; SQL state [null]; error code [0]; exception while
executing query: java.io.IOException: POST failed, error code 500 and response: {"code":"999","data":null,"msg":"Timeout
visiting cube! Check why coprocessor exception is not sent back? In coprocessor Self-termination
is checked every 100 scanned rows, the configured timeout(54000) cannot support this many
scans?\nwhile executing SQL: \"select COALESCE(SUM(a.total_sale_money_kpi),0) as total_sale_money_kpi
, COALESCE(SUM(a.total_sale_count_kpi),0) as 
2、by total_sale_money_kpi desc ### Cause: java.sql.SQLException: exception while executing
query: java.io.IOException: POST failed, error code 500 and response: {"code":"999","data":null,"msg":"org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: Coprocessor passed deadline! Maybe server is
overloaded at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.checkDeadline(CubeVisitService.java:225)
at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:259)
at org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555)
at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7931) at org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1969)
at org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1951)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2191) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:183) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:163)\nwhile
executing SQL: 



Mime
View raw message