kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liu Shaohui (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-4021) Async Broadcast of project schema may cause creating cube failed
Date Wed, 29 May 2019 04:30:00 GMT
Liu Shaohui created KYLIN-4021:
----------------------------------

             Summary: Async Broadcast of project schema may cause creating cube failed
                 Key: KYLIN-4021
                 URL: https://issues.apache.org/jira/browse/KYLIN-4021
             Project: Kylin
          Issue Type: Bug
          Components: Metadata
            Reporter: Liu Shaohui


In our prod cluster, we found some creating cube requests failed for the model not found.

The problem is that users will create the cube right after creating the model success. But
the the two requests may be routed to two different servers.

When the other server receive creating cube request, the project schema may be not updated
for the async Broadcast and the server can not found the model related to the cube.

the log at query server 1
{code:java}
kylin.log.11:2019-05-27 10:26:44,143 INFO  [http-bio-7070-exec-962] model.DataModelManager:248
: Saving Model model_k1_bb_83_uyyyyyyy3636 to Project BigBI_Hive with bigbi_kylin as owner
kylin.log.11:2019-05-27 10:26:44,144 INFO  [http-bio-7070-exec-962] model.DataModelManager:185
: Model model_k1_bb_83_uyyyyyyy3636 is missing or unloaded yet
kylin.log.11:2019-05-27 10:26:44,145 INFO  [http-bio-7070-exec-962] persistence.ResourceStore:309
: Update resource: /model_desc/model_k1_bb_83_uyyyyyyy3636.json with content:{code}
and the log at query server 2
{code:java}
2019-05-27 10:26:44,296 WARN  [http-bio-7070-exec-132] cube.CubeDescManager:195 : Broken cube
desc CubeDesc [name=cube_b_bb_83_uyyyyyyy3636]
java.lang.NullPointerException: DateModelDesc(model_k1_bb_83_uyyyyyyy3636) not found
        at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:235)
        at org.apache.kylin.cube.model.CubeDesc.init(CubeDesc.java:664)
        at org.apache.kylin.cube.CubeDescManager.createCubeDesc(CubeDescManager.java:193)
        at org.apache.kylin.rest.service.CubeService.createCubeAndDesc(CubeService.java:216)
        at org.apache.kylin.rest.service.CubeService$$FastClassBySpringCGLIB$$17a07c0e.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
        at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:69)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
        at org.apache.kylin.rest.service.CubeService$$EnhancerBySpringCGLIB$$20946622.createCubeAndDesc(<generated>)
        at org.apache.kylin.rest.controller.CubeController.saveCubeDesc(CubeController.java:735)
        at sun.reflect.GeneratedMethodAccessor341.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498){code}
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message