kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 赵天烁 <zhaotians...@meizu.com>
Subject Re: Re: kylin web UI become too slow since update to 2.0 beta
Date Tue, 07 Mar 2017 03:24:17 GMT
[cid:_Foxmail.1@dc3c9f15-0512-df55-d004-96d5894cedbd]
[cid:_Foxmail.1@0b8a2a38-6575-fd90-b30c-9c6e34d7405a]
crash msg:
{"code":"999","data":null,"msg":"java.lang.RuntimeException: org.apache.kylin.job.exception.PersistentException:
java.io.IOException: Blocklist for /user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!","stacktrace":"org.apache.kylin.rest.exception.InternalErrorException: java.lang.RuntimeException:
org.apache.kylin.job.exception.PersistentException: java.io.IOException: Blocklist for /user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!\n\tat org.apache.kylin.rest.controller.JobController.list(JobController.java:76)\n\tat
sun.reflect.GeneratedMethodAccessor135.invoke(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
java.lang.reflect.Method.invoke(Method.java:606)\n\tat org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:221)\n\tat
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136)\n\tat
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)\n\tat
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)\n\tat
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)\n\tat
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)\n\tat
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:933)\n\tat
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)\n\tat
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:951)\n\tat
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:842)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:622)\n\tat
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:827)\n\tat
javax.servlet.http.HttpServlet.service(HttpServlet.java:729)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230)\n\tat
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)\n\tat
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)\n\tat org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)\n\tat
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)\n\tat
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)\n\tat
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)\n\tat
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)\n\tat
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)\n\tat
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)\n\tat
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343)\n\tat
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260)\n\tat
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)\n\tat
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)\n\tat
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209)\n\tat com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244)\n\tat
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192)\n\tat
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165)\n\tat
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198)\n\tat
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)\n\tat org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474)\n\tat
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140)\n\tat org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79)\n\tat
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624)\n\tat
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)\n\tat org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349)\n\tat
org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783)\n\tat org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)\n\tat
org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:789)\n\tat
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1437)\n\tat
org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)\n\tat
java.lang.Thread.run(Thread.java:745)\nCaused by: java.lang.RuntimeException: org.apache.kylin.job.exception.PersistentException:
java.io.IOException: Blocklist for /user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!\n\tat org.apache.kylin.job.execution.ExecutableManager.getAllOutputs(ExecutableManager.java:178)\n\tat
org.apache.kylin.rest.service.JobService.listCubeJobInstance(JobService.java:189)\n\tat org.apache.kylin.rest.service.JobService.listAllJobs(JobService.java:162)\n\tat
org.apache.kylin.rest.service.JobService.listAllJobs(JobService.java:144)\n\tat org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$83a44b2a.invoke(<generated>)\n\tat
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:629)\n\tat
org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$89d6b932.listAllJobs(<generated>)\n\tat
org.apache.kylin.rest.controller.JobController.list(JobController.java:73)\n\t... 72 more\nCaused
by: org.apache.kylin.job.exception.PersistentException: java.io.IOException: Blocklist for
/user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!\n\tat org.apache.kylin.job.dao.ExecutableDao.getJobOutputs(ExecutableDao.java:120)\n\tat
org.apache.kylin.job.execution.ExecutableManager.getAllOutputs(ExecutableManager.java:170)\n\t...
80 more\nCaused by: java.io.IOException: Blocklist for /user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!\n\tat org.apache.hadoop.hdfs.DFSInputStream.fetchLocatedBlocksAndGetLastBlockLength(DFSInputStream.java:277)\n\tat
org.apache.hadoop.hdfs.DFSInputStream.openInfo(DFSInputStream.java:231)\n\tat org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:908)\n\tat
org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:560)\n\tat org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:790)\n\tat
org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:837)\n\tat java.io.DataInputStream.read(DataInputStream.java:149)\n\tat
java.io.DataInputStream.read(DataInputStream.java:149)\n\tat com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.ensureLoaded(ByteSourceJsonBootstrapper.java:489)\n\tat
com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.detectEncoding(ByteSourceJsonBootstrapper.java:126)\n\tat
com.fasterxml.jackson.core.json.ByteSourceJsonBootstrapper.constructParser(ByteSourceJsonBootstrapper.java:215)\n\tat
com.fasterxml.jackson.core.JsonFactory._createParser(JsonFactory.java:1240)\n\tat com.fasterxml.jackson.core.JsonFactory.createParser(JsonFactory.java:802)\n\tat
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2796)\n\tat org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:62)\n\tat
org.apache.kylin.common.persistence.JsonSerializer.deserialize(JsonSerializer.java:40)\n\tat
org.apache.kylin.common.persistence.ResourceStore.getAllResources(ResourceStore.java:189)\n\tat
org.apache.kylin.job.dao.ExecutableDao.getJobOutputs(ExecutableDao.java:117)\n\t... 81 more\n","exception":"java.lang.RuntimeException:
org.apache.kylin.job.exception.PersistentException: java.io.IOException: Blocklist for /user/kylin/kylin_metadata/resources/execute_output/3a06ea90-ba4a-4098-b226-eee1bf85b233-02
has changed!","url":"http://10.3.141.83:7070/kylin/api/jobs"}

some time it success:
[cid:_Foxmail.1@fb515e17-3d08-231a-2c4c-b86255c2c45a]
________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<mailto:zhaotianshuo@meizu.com>

珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com

From: Guosheng Lu<mailto:guosheng.lu@kyligence.io>
Date: 2017-03-07 10:58
To: 赵天烁<mailto:zhaotianshuo@meizu.com>
CC: user<mailto:user@kylin.apache.org>
Subject: Re: kylin web UI become too slow since update to 2.0 beta
Thx! Tianshuo:
We can not reproduce, so could you help us  to debug in your  chrome network  to watch if
 ajax  request  cost  you more  time !

Best Regards!
Bob Lu|陆国圣
http://kyligence.io

发件人: 赵天烁 <zhaotianshuo@meizu.com>
日期: 2017年3月7日 星期二 上午10:44
至: luguosheng <guosheng.lu@kyligence.io>
抄送: user <user@kylin.apache.org>
主题: Re: Re: kylin web UI become too slow since update to 2.0 beta

1.chrome v46
2.4example when I create a new cube ,after go through all the step ,when I click save.....it
stuck,edit cube is the same thing.
another one is when I click the monitor tab ,or the refresh button in that tab. it will stuck
in loading jobs....
PS: when I call the  rest API to create cube or get job status,it also stuck just like when
I do the same thing in web UI
[cid:_Foxmail.1@3ea593e7-19d1-56ae-3700-7ca01a0fafe3]

________________________________
赵天烁
Kevin Zhao
zhaotianshuo@meizu.com<mailto:zhaotianshuo@meizu.com>

珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China
meizu.com

From: Guosheng Lu<mailto:guosheng.lu@kyligence.io>
Date: 2017-03-07 10:18
To: 赵天烁<mailto:zhaotianshuo@meizu.com>
CC: user@kylin.apache.org<mailto:user@kylin.apache.org>
Subject: Re: kylin web UI become too slow since update to 2.0 beta
Hi ,
I want to know some details
1.which browser you use ?
2.and in what situation it becomes slow? form submit  or just when you open web page


Best Regards!
Bob Lu|陆国圣
http://kyligence.io

发件人: 赵天烁 <zhaotianshuo@meizu.com>
答复: "user@kylin.apache.org" <user@kylin.apache.org>
日期: 2017年3月7日 星期二 上午10:06
至: user <user@kylin.apache.org>
主题: kylin web UI become too slow since update to 2.0 beta

cube
Mime
View raw message