kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Yang <liy...@apache.org>
Subject Re: 答复: build cube时报Failed to parse hive conf file
Date Fri, 18 Nov 2016 08:52:23 GMT
>From the log, it is complaining file $KYLIN_HOME/conf/kylin_hive_conf.xml
is missing.

On Wed, Nov 16, 2016 at 3:29 PM, ShangYong Li(李尚勇) <syli@hillstonenet.com>
wrote:

> 可以的,刚开始是可以build的,不会报这个问题
>
>
>
> Thanks
>
> ShangYong Li
>
>
>
> *发件人:* Dong Li [mailto:lidong@apache.org]
> *发送时间:* 2016年11月16日 15:26
> *收件人:* user@kylin.apache.org
> *主题:* Re: build cube时报Failed to parse hive conf file
>
>
>
> Can you find kylin_hive_conf.xml in $KYLIN_HOME/conf?
>
>
>
> Thanks,
>
> Dong Li
>
>
>
>  Original Message
>
> *Sender:* ShangYong Li(李尚勇)<syli@Hillstonenet.com>
>
> *Recipient:* user@kylin.apache.org<user@kylin.apache.org>
>
> *Date:* Wednesday, Nov 16, 2016 15:07
>
> *Subject:* build cube时报Failed to parse hive conf file
>
>
>
> 大家好:
>
> 我在web UI上建好model和cube后,build的时候,刚开始能成功,但是后来再build就会报Failed
to parse hive
> conf file,在monitor页面也找不到任何这个job的信息。
>
> 我是用的kylin版本是:1.5.3
>
> 下面是kylin.log
>
> 2016-11-16 14:43:45,192 INFO  [http-bio-7070-exec-10]
> mr.BatchCubingJobBuilder2:50 : MR_V2 new job to BUILD segment
> test_auto_build_cube[20161114000000_20161116235500]
>
> 2016-11-16 14:43:45,193 ERROR [http-bio-7070-exec-10]
> engine.JobEngineConfig:105 : fail to locate kylin_hive_conf.xml
>
> 2016-11-16 14:43:45,194 ERROR [http-bio-7070-exec-10]
> controller.CubeController:284 : Failed to parse hive conf file
>
> java.lang.RuntimeException: Failed to parse hive conf file
>
>          at org.apache.kylin.job.JoinedFlatTable.
> generateHiveSetStatements(JoinedFlatTable.java:76)
>
>          at org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.
> createCountHiveTableStep(HiveMRInput.java:132)
>
>          at org.apache.kylin.source.hive.HiveMRInput$BatchCubingInputSide.
> addStepPhase1_CreateFlatTable(HiveMRInput.java:120)
>
>          at org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build(
> BatchCubingJobBuilder2.java:57)
>
>          at org.apache.kylin.engine.mr.MRBatchCubingEngine2.
> createBatchCubingJob(MRBatchCubingEngine2.java:29)
>
>          at org.apache.kylin.engine.EngineFactory.createBatchCubingJob(
> EngineFactory.java:51)
>
>          at org.apache.kylin.rest.service.JobService.submitJob(
> JobService.java:209)
>
>          at org.apache.kylin.rest.service.JobService$$FastClassByCGLIB$$
> 83a44b2a.invoke(<generated>)
>
>          at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
>
>          at org.springframework.aop.framework.Cglib2AopProxy$
> CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
>
>          at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:150)
>
>          at org.springframework.security.access.intercept.aopalliance.
> MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64)
>
>          at org.springframework.aop.framework.ReflectiveMethodInvocation.
> proceed(ReflectiveMethodInvocation.java:172)
>
>          at org.springframework.aop.framework.Cglib2AopProxy$
> DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
>
>          at org.apache.kylin.rest.service.JobService$$EnhancerByCGLIB$$
> 8e5762ba.submitJob(<generated>)
>
>          at org.apache.kylin.rest.controller.CubeController.
> buildInternal(CubeController.java:281)
>
>          at org.apache.kylin.rest.controller.CubeController.
> rebuild(CubeController.java:259)
>
>          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>          at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
>
>          at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>
>          at java.lang.reflect.Method.invoke(Method.java:497)
>
>          at org.springframework.web.method.support.
> InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>
>          at org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:126)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:96)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandlerMethod(
> RequestMappingHandlerAdapter.java:617)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:578)
>
>          at org.springframework.web.servlet.mvc.method.
> AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>
>          at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:923)
>
>          at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:852)
>
>          at org.springframework.web.servlet.FrameworkServlet.
> processRequest(FrameworkServlet.java:882)
>
>          at org.springframework.web.servlet.FrameworkServlet.
> doPut(FrameworkServlet.java:800)
>
>          at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
>
>          at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:303)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>
>          at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>
>          at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.access.
> ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.session.
> SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.
> java:113)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.servletapi.
> SecurityContextHolderAwareRequestFilter.doFilter(
> SecurityContextHolderAwareRequestFilter.java:54)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.savedrequest.
> RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> *www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)*
> <http://www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)>
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.ui.
> DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilt
> er.java:91)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> AbstractAuthenticationProcessingFilter.doFilter(
> AbstractAuthenticationProcessingFilter.java:183)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.logout.
> LogoutFilter.doFilter(LogoutFilter.java:105)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.context.
> SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilt
> er.java:87)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.FilterChainProxy.
> doFilterInternal(FilterChainProxy.java:192)
>
>          at org.springframework.security.web.FilterChainProxy.doFilter(
> FilterChainProxy.java:160)
>
>          at org.springframework.web.filter.DelegatingFilterProxy.
> invokeDelegate(DelegatingFilterProxy.java:346)
>
>          at org.springframework.web.filter.DelegatingFilterProxy.doFilter(
> DelegatingFilterProxy.java:259)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:195)
>
>          at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:266)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:220)
>
>          at org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:122)
>
>          at org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:505)
>
>          at org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:169)
>
>          at org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:103)
>
>          at org.apache.catalina.valves.AccessLogValve.invoke(
> AccessLogValve.java:956)
>
>          at org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:116)
>
>          at org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:436)
>
>          at org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1078)
>
>          at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:625)
>
>          at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.
> run(JIoEndpoint.java:318)
>
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>
>          at org.apache.tomcat.util.threads.TaskThread$
> WrappingRunnable.run(TaskThread.java:61)
>
>          at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.lang.RuntimeException: fail to locate kylin_hive_conf.xml
>
>          at org.apache.kylin.job.engine.JobEngineConfig.
> getHiveConfFilePath(JobEngineConfig.java:106)
>
>          at org.apache.kylin.job.JoinedFlatTable.
> generateHiveSetStatements(JoinedFlatTable.java:58)
>
>          ... 86 more
>
> 2016-11-16 14:43:45,196 ERROR [http-bio-7070-exec-10]
> controller.BasicController:44 :
>
> org.apache.kylin.rest.exception.InternalErrorException: Failed to parse
> hive conf file
>
>          at org.apache.kylin.rest.controller.CubeController.
> buildInternal(CubeController.java:285)
>
>          at org.apache.kylin.rest.controller.CubeController.
> rebuild(CubeController.java:259)
>
>          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>          at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
>
>          at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>
>          at java.lang.reflect.Method.invoke(Method.java:497)
>
>          at org.springframework.web.method.support.
> InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
>
>          at org.springframework.web.method.support.InvocableHandlerMethod.
> invokeForRequest(InvocableHandlerMethod.java:126)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> ServletInvocableHandlerMethod.invokeAndHandle(
> ServletInvocableHandlerMethod.java:96)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.invokeHandlerMethod(
> RequestMappingHandlerAdapter.java:617)
>
>          at org.springframework.web.servlet.mvc.method.annotation.
> RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.
> java:578)
>
>          at org.springframework.web.servlet.mvc.method.
> AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
>
>          at org.springframework.web.servlet.DispatcherServlet.
> doDispatch(DispatcherServlet.java:923)
>
>          at org.springframework.web.servlet.DispatcherServlet.
> doService(DispatcherServlet.java:852)
>
>          at org.springframework.web.servlet.FrameworkServlet.
> processRequest(FrameworkServlet.java:882)
>
>          at org.springframework.web.servlet.FrameworkServlet.
> doPut(FrameworkServlet.java:800)
>
>          at javax.servlet.http.HttpServlet.service(HttpServlet.java:653)
>
>          at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:303)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.apache.tomcat.websocket.server.WsFilter.doFilter(
> WsFilter.java:52)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:330)
>
>          at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
>
>          at org.springframework.security.web.access.intercept.
> FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.access.
> ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.session.
> SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.
> java:113)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.servletapi.
> SecurityContextHolderAwareRequestFilter.doFilter(
> SecurityContextHolderAwareRequestFilter.java:54)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.savedrequest.
> RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> *www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)*
> <http://www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201)>
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.ui.
> DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilt
> er.java:91)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.
> AbstractAuthenticationProcessingFilter.doFilter(
> AbstractAuthenticationProcessingFilter.java:183)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.authentication.logout.
> LogoutFilter.doFilter(LogoutFilter.java:105)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.context.
> SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilt
> er.java:87)
>
>          at org.springframework.security.web.FilterChainProxy$
> VirtualFilterChain.doFilter(FilterChainProxy.java:342)
>
>          at org.springframework.security.web.FilterChainProxy.
> doFilterInternal(FilterChainProxy.java:192)
>
>          at org.springframework.security.web.FilterChainProxy.doFilter(
> FilterChainProxy.java:160)
>
>          at org.springframework.web.filter.DelegatingFilterProxy.
> invokeDelegate(DelegatingFilterProxy.java:346)
>
>          at org.springframework.web.filter.DelegatingFilterProxy.doFilter(
> DelegatingFilterProxy.java:259)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:195)
>
>          at com.thetransactioncompany.cors.CORSFilter.doFilter(
> CORSFilter.java:266)
>
>          at org.apache.catalina.core.ApplicationFilterChain.
> internalDoFilter(ApplicationFilterChain.java:241)
>
>          at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
>
>          at org.apache.catalina.core.StandardWrapperValve.invoke(
> StandardWrapperValve.java:220)
>
>          at org.apache.catalina.core.StandardContextValve.invoke(
> StandardContextValve.java:122)
>
>          at org.apache.catalina.authenticator.AuthenticatorBase.invoke(
> AuthenticatorBase.java:505)
>
>          at org.apache.catalina.core.StandardHostValve.invoke(
> StandardHostValve.java:169)
>
>          at org.apache.catalina.valves.ErrorReportValve.invoke(
> ErrorReportValve.java:103)
>
>          at org.apache.catalina.valves.AccessLogValve.invoke(
> AccessLogValve.java:956)
>
>          at org.apache.catalina.core.StandardEngineValve.invoke(
> StandardEngineValve.java:116)
>
>          at org.apache.catalina.connector.CoyoteAdapter.service(
> CoyoteAdapter.java:436)
>
>          at org.apache.coyote.http11.AbstractHttp11Processor.process(
> AbstractHttp11Processor.java:1078)
>
>          at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.
> process(AbstractProtocol.java:625)
>
>          at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.
> run(JIoEndpoint.java:318)
>
>          at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>
>          at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>
>          at org.apache.tomcat.util.threads.TaskThread$
> WrappingRunnable.run(TaskThread.java:61)
>
>          at java.lang.Thread.run(Thread.java:745)
>
>
>
> Thanks
>
> ShangYong Li
>
>
>

Mime
View raw message