kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_hadoop"<lk_had...@163.com>
Subject 回复: 回复: 回复:CubeBuildingCLI not work well
Date Wed, 28 Aug 2019 01:21:34 GMT
NowI have upgrade from kylin2.6.1 to kylin2.6.3 , I still face the issue of building system
cube.

I follow the tutorial use cron job to call system_cube_build.sh , eche time I will get the
error log ,and I can't see any build job from the web ui:

2019-08-27 20:20:11,909 DEBUG [main] cachesync.CachedCrudAssist:118 : Reloading DataModelDesc
from kylin_metadata(key='/model_desc')@kylin_metadata@hbase
...
2019-08-27 16:40:02,319 ERROR [http-bio-7070-exec-10] controller.BasicController:63 : 
org.apache.kylin.rest.exception.InternalErrorException
        at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:399)
        at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:355)
        at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:344)
...
Caused by: java.lang.NullPointerException
        at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:995)
        at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394)
        ... 80 more
2019-08-27 16:40:02,342 ERROR [http-bio-7070-exec-8] controller.CubeController:398 : 
java.lang.NullPointerException
        at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:995)
        at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:394)
        at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:355)
        at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:344)

...

and I also can find some error from the system cube build's log :

2019-08-27 20:20:11,943 ERROR [main] cachesync.CachedCrudAssist:143 : Error loading DataModelDesc
at /model_desc/gaoji_sale_model.json
java.lang.IllegalStateException: Error loading DataModelDesc at /model_desc/gaoji_sale_model.json
 at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:168)
 at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadQuietlyAt(CachedCrudAssist.java:141)
 at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAll(CachedCrudAssist.java:124)
 at org.apache.kylin.metadata.model.DataModelManager.init(DataModelManager.java:99)
 at org.apache.kylin.metadata.model.DataModelManager.<init>(DataModelManager.java:79)
....
Caused by: java.lang.IllegalStateException: No project found for model gaoji_sale_model
 at org.apache.kylin.metadata.project.ProjectManager.getProjectOfModel(ProjectManager.java:384)
 at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:89)
 at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:86)
 at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:159)
 ... 45 more

2019-08-27 20:20:11,952 ERROR [main] cachesync.CachedCrudAssist:143 : Error loading DataModelDesc
at /model_desc/membership_marking.json
java.lang.IllegalStateException: Error loading DataModelDesc at /model_desc/membership_marking.json
...
Caused by: java.lang.IllegalStateException: No project found for model membership_marking
 at org.apache.kylin.metadata.project.ProjectManager.getProjectOfModel(ProjectManager.java:384)
 at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:89)
 at org.apache.kylin.metadata.model.DataModelManager$1.initEntityAfterReload(DataModelManager.java:86)
 at org.apache.kylin.metadata.cachesync.CachedCrudAssist.reloadAt(CachedCrudAssist.java:159)
 ... 45 more

all that models which cause error , I've deleted already,
why kylin still want to load it from meta_table ?
how can I delete it ?
is this the reason which cause the system cube build error ? but when I use admin to reload
metadata from the web ui , all the build jobs should be executed will appear to the web ui
and begin to run. 

2019-08-28 

lk_hadoop 



发件人:"lk_hadoop"<lk_hadoop@163.com>
发送时间:2019-04-08 19:24
主题:回复: 回复:CubeBuildingCLI not work well
收件人:"user"<user@kylin.apache.org>
抄送:

thanks for reply @Chao Long . I have confirmed that there no other crontab tasks , and the
error msg just print out when the crontab job called.

2019-04-08 

lk_hadoop 



发件人:"Chao Long" <wayne.l@qq.com>
发送时间:2019-04-08 14:47
主题:回复:CubeBuildingCLI not work well
收件人:"user"<user@kylin.apache.org>
抄送:

Hi,
   CubeBuildingCLI will not call method in CubeController, the stack trace show some exceptions
throw from method CubeController.build(), which will be called by rest api. So you may check
if there are other running cube-building crontab tasks.


------------------
Best Regards,
Chao Long
------------------ 原始邮件 ------------------
发件人: "lk_hadoop"<lk_hadoop@163.com>;
发送时间: 2019年3月25日(星期一) 下午5:20
收件人: "user"<user@kylin.apache.org>;
主题: CubeBuildingCLI not work well


hi,all:
    I'm using kylin 2.6.1 with CDH57, When calling CubeBuildingCLI the job will not be scheduled,only
when I click "reload metadata" on kylin's web , The job can be scheduled.
    and if CubeBuildingCLI was called from  crontab , I can see error message from the log
:

    2019-03-25 16:20:02,325 ERROR [http-bio-7070-exec-2] controller.BasicController:63 : 
org.apache.kylin.rest.exception.InternalErrorException
 at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:398)
 at org.apache.kylin.rest.controller.CubeController.rebuild(CubeController.java:354)
 at org.apache.kylin.rest.controller.CubeController.build(CubeController.java:343)
 at sun.reflect.GeneratedMethodAccessor210.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498)
 at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
 at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133)
 at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97)
 at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:827)
 at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:738)
 at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85)
 at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967)
 at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901)
 at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970)
 at org.springframework.web.servlet.FrameworkServlet.doPut(FrameworkServlet.java:883)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
 at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:846)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)
 at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)
 at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215)
 at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)
 at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
 at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
 at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
 at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
 at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
 at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
 at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)
 at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
 at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
 at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:494)
 at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
 at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:104)
 at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:1025)
 at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
 at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1137)
 at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
 at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
 at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
 at org.apache.kylin.rest.controller.CubeController.checkBuildingSegment(CubeController.java:984)
 at org.apache.kylin.rest.controller.CubeController.buildInternal(CubeController.java:393)
 ... 77 more

2019-03-25


lk_hadoop 
Mime
View raw message