Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id EE330200CFC for ; Thu, 24 Aug 2017 02:27:25 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id EC30216A0BA; Thu, 24 Aug 2017 00:27:25 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BDB1516A0B7 for ; Thu, 24 Aug 2017 02:27:24 +0200 (CEST) Received: (qmail 22706 invoked by uid 500); 24 Aug 2017 00:27:23 -0000 Mailing-List: contact dev-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kylin.apache.org Delivered-To: mailing list dev@kylin.apache.org Received: (qmail 22695 invoked by uid 99); 24 Aug 2017 00:27:23 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Aug 2017 00:27:23 +0000 Received: from mail-io0-f174.google.com (mail-io0-f174.google.com [209.85.223.174]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 385BA1A002B for ; Thu, 24 Aug 2017 00:27:22 +0000 (UTC) Received: by mail-io0-f174.google.com with SMTP id g135so5883485iog.1 for ; Wed, 23 Aug 2017 17:27:22 -0700 (PDT) X-Gm-Message-State: AHYfb5h6CndG6lEi+9QXxrL71Y0CmIp0N9efOHDIaAWxLTU4K52RTR1a thie/I7hIsV9uSgIFbpcY9qWhaNriA== X-Received: by 10.107.47.88 with SMTP id j85mr3575013ioo.237.1503534441701; Wed, 23 Aug 2017 17:27:21 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.25.131 with HTTP; Wed, 23 Aug 2017 17:27:01 -0700 (PDT) In-Reply-To: <1503480932748-8782.post@n6.nabble.com> References: <1503480932748-8782.post@n6.nabble.com> From: Billy Liu Date: Thu, 24 Aug 2017 08:27:01 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: KYLIN2.1 To: dev Content-Type: multipart/alternative; boundary="001a113784704e2a6a055774e416" archived-at: Thu, 24 Aug 2017 00:27:26 -0000 --001a113784704e2a6a055774e416 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Have you followed the guide: http://kylin.apache.org/docs21/tutorial/cube_spark.html Please describe the reproduce steps, especially the environment variable exported. 2017-08-23 17:35 GMT+08:00 kylin_liu : > =E7=8E=B0=E5=9C=A8=E5=87=86=E5=A4=87=E7=94=A8spark =E5=81=9A=E8=AE=A1=E7= =AE=97=E5=BC=95=E6=93=8E=EF=BC=8C=E6=A0=B7=E6=9C=ACcube =E7=BC=96=E8=AF=91= =E7=9A=84=E6=97=B6=E5=80=99=E5=B0=B1=E5=87=BA=E7=8E=B0=E9=97=AE=E9=A2=98=E4= =BA=86=EF=BC=8C=E5=90=84=E4=BD=8D=E6=98=AF=E5=90=A6=E6=9C=89=E7=A2=B0=E5=88= =B0=E8=BF=99=E4=B8=AA=E9=97=AE=E9=A2=98=E5=91=A2=EF=BC=9F > > 2017-08-23 04:22:33,551 ERROR [http-bio-7070-exec-9] > controller.CubeController:305 : > org/apache/spark/api/java/function/PairFunction > java.lang.NoClassDefFoundError: > org/apache/spark/api/java/function/PairFunction > at > org.apache.kylin.engine.spark.SparkBatchCubingJobBuilder2. > addLayerCubingSteps(SparkBatchCubingJobBuilder2.java:48) > at > org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build( > BatchCubingJobBuilder2.java:66) > at > org.apache.kylin.engine.spark.SparkBatchCubingEngine2. > createBatchCubingJob(SparkBatchCubingEngine2.java:30) > at > org.apache.kylin.engine.EngineFactory.createBatchCubingJob( > EngineFactory.java:56) > at > org.apache.kylin.rest.service.JobService.submitJobInternal( > JobService.java:238) > at org.apache.kylin.rest.service.JobService.submitJob( > JobService.java:208) > at > org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$ > 83a44b2a.invoke() > at org.springframework.cglib.proxy.MethodProxy.invoke( > MethodProxy.java:204) > at > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation. > invokeJoinpoint(CglibAopProxy.java:720) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:157) > at > org.springframework.security.access.intercept.aopalliance. > MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:179) > at > org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor= . > intercept(CglibAopProxy.java:655) > at > org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$ > 39b3ce22.submitJob() > at > org.apache.kylin.rest.controller.CubeController. > buildInternal(CubeController.java:302) > at > org.apache.kylin.rest.controller.CubeController. > rebuild(CubeController.java:264) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= : > 62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke( > InvocableHandlerMethod.java:221) > at > org.springframework.web.method.support.InvocableHandlerMethod. > invokeForRequest(InvocableHandlerMethod.java:136) > at > org.springframework.web.servlet.mvc.method.annotation. > ServletInvocableHandlerMethod.invokeAndHandle( > ServletInvocableHandlerMethod.java:110) > at > org.springframework.web.servlet.mvc.method.annotation. > RequestMappingHandlerAdapter.invokeHandlerMethod( > RequestMappingHandlerAdapter.java:832) > at > org.springframework.web.servlet.mvc.method.annotation. > RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter. > java:743) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter. > handle(AbstractHandlerMethodAdapter.java:85) > at > org.springframework.web.servlet.DispatcherServlet. > doDispatch(DispatcherServlet.java:961) > at > org.springframework.web.servlet.DispatcherServlet. > doService(DispatcherServlet.java:895) > at > org.springframework.web.servlet.FrameworkServlet.processRequest( > FrameworkServlet.java:967) > at > org.springframework.web.servlet.FrameworkServlet. > doPut(FrameworkServlet.java:880) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:653) > at > org.springframework.web.servlet.FrameworkServlet. > service(FrameworkServlet.java:843) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at org.apache.tomcat.websocket.server.WsFilter.doFilter( > WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:316) > at > org.springframework.security.web.access.intercept. > FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126) > at > org.springframework.security.web.access.intercept. > FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.access.ExceptionTranslationFilter. > doFilter(ExceptionTranslationFilter.java:114) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.session.SessionManagementFilter.doFilter= ( > SessionManagementFilter.java:122) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication. > AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter. > java:111) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.servletapi.SecurityContextHolderAwareReq= u > estFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:169) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.savedrequest.RequestCacheAwareFilter. > doFilter(RequestCacheAwareFilter.java:48) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication.www. > BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter. > java:158) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication. > AbstractAuthenticationProcessingFilter.doFilter( > AbstractAuthenticationProcessingFilter.java:205) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication.logout. > LogoutFilter.doFilter(LogoutFilter.java:120) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.header.HeaderWriterFilter. > doFilterInternal(HeaderWriterFilter.java:64) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.context.request.async. > WebAsyncManagerIntegrationFilter.doFilterInternal( > WebAsyncManagerIntegrationFilter.java:53) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.context.SecurityContextPersistenceFilt > er.doFilter(SecurityContextPersistenceFilter.java:91) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.FilterChainProxy.doFilterInternal( > FilterChainProxy.java:213) > at > org.springframework.security.web.FilterChainProxy.doFilter( > FilterChainProxy.java:176) > at > org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate( > DelegatingFilterProxy.java:346) > at > org.springframework.web.filter.DelegatingFilterProxy.doFilter( > DelegatingFilterProxy.java:262) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at com.thetransactioncompany.cors.CORSFilter.doFilter( > CORSFilter.java:209) > at com.thetransactioncompany.cors.CORSFilter.doFilter( > CORSFilter.java:244) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at > org.apache.catalina.core.StandardWrapperValve.invoke( > StandardWrapperValve.java:220) > at > org.apache.catalina.core.StandardContextValve.invoke( > StandardContextValve.java:122) > at > org.apache.catalina.authenticator.AuthenticatorBase.invoke( > AuthenticatorBase.java:505) > at > org.apache.catalina.core.StandardHostValve.invoke( > StandardHostValve.java:169) > at > org.apache.catalina.valves.ErrorReportValve.invoke( > ErrorReportValve.java:103) > at > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) > at > org.apache.catalina.core.StandardEngineValve.invoke( > StandardEngineValve.java:116) > at > org.apache.catalina.connector.CoyoteAdapter.service( > CoyoteAdapter.java:436) > at > org.apache.coyote.http11.AbstractHttp11Processor.process( > AbstractHttp11Processor.java:1078) > at > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler. > process(AbstractProtocol.java:625) > at > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor. > run(JIoEndpoint.java:318) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at > org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run( > TaskThread.java:61) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.ClassNotFoundException: > org.apache.spark.api.java.function.PairFunction > at > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > WebappClassLoaderBase.java:1858) > at > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > WebappClassLoaderBase.java:1701) > ... 92 more > 2017-08-23 04:22:33,554 ERROR [http-bio-7070-exec-9] > controller.BasicController:57 : > org.apache.kylin.rest.exception.InternalErrorException: > org/apache/spark/api/java/function/PairFunction > at > org.apache.kylin.rest.controller.CubeController. > buildInternal(CubeController.java:306) > at > org.apache.kylin.rest.controller.CubeController. > rebuild(CubeController.java:264) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= : > 62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.springframework.web.method.support.InvocableHandlerMethod.doInvoke( > InvocableHandlerMethod.java:221) > at > org.springframework.web.method.support.InvocableHandlerMethod. > invokeForRequest(InvocableHandlerMethod.java:136) > at > org.springframework.web.servlet.mvc.method.annotation. > ServletInvocableHandlerMethod.invokeAndHandle( > ServletInvocableHandlerMethod.java:110) > at > org.springframework.web.servlet.mvc.method.annotation. > RequestMappingHandlerAdapter.invokeHandlerMethod( > RequestMappingHandlerAdapter.java:832) > at > org.springframework.web.servlet.mvc.method.annotation. > RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter. > java:743) > at > org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter. > handle(AbstractHandlerMethodAdapter.java:85) > at > org.springframework.web.servlet.DispatcherServlet. > doDispatch(DispatcherServlet.java:961) > at > org.springframework.web.servlet.DispatcherServlet. > doService(DispatcherServlet.java:895) > at > org.springframework.web.servlet.FrameworkServlet.processRequest( > FrameworkServlet.java:967) > at > org.springframework.web.servlet.FrameworkServlet. > doPut(FrameworkServlet.java:880) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:653) > at > org.springframework.web.servlet.FrameworkServlet. > service(FrameworkServlet.java:843) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:303) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at org.apache.tomcat.websocket.server.WsFilter.doFilter( > WsFilter.java:52) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:316) > at > org.springframework.security.web.access.intercept. > FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:126) > at > org.springframework.security.web.access.intercept. > FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:90) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.access.ExceptionTranslationFilter. > doFilter(ExceptionTranslationFilter.java:114) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.session.SessionManagementFilter.doFilter= ( > SessionManagementFilter.java:122) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication. > AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter. > java:111) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.servletapi.SecurityContextHolderAwareReq= u > estFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:169) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.savedrequest.RequestCacheAwareFilter. > doFilter(RequestCacheAwareFilter.java:48) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication.www. > BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter. > java:158) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication. > AbstractAuthenticationProcessingFilter.doFilter( > AbstractAuthenticationProcessingFilter.java:205) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.authentication.logout. > LogoutFilter.doFilter(LogoutFilter.java:120) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.header.HeaderWriterFilter. > doFilterInternal(HeaderWriterFilter.java:64) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.context.request.async. > WebAsyncManagerIntegrationFilter.doFilterInternal( > WebAsyncManagerIntegrationFilter.java:53) > at > org.springframework.web.filter.OncePerRequestFilter. > doFilter(OncePerRequestFilter.java:107) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.context.SecurityContextPersistenceFilt > er.doFilter(SecurityContextPersistenceFilter.java:91) > at > org.springframework.security.web.FilterChainProxy$ > VirtualFilterChain.doFilter(FilterChainProxy.java:330) > at > org.springframework.security.web.FilterChainProxy.doFilterInternal( > FilterChainProxy.java:213) > at > org.springframework.security.web.FilterChainProxy.doFilter( > FilterChainProxy.java:176) > at > org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate( > DelegatingFilterProxy.java:346) > at > org.springframework.web.filter.DelegatingFilterProxy.doFilter( > DelegatingFilterProxy.java:262) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at com.thetransactioncompany.cors.CORSFilter.doFilter( > CORSFilter.java:209) > at com.thetransactioncompany.cors.CORSFilter.doFilter( > CORSFilter.java:244) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( > ApplicationFilterChain.java:241) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter( > ApplicationFilterChain.java:208) > at > org.apache.catalina.core.StandardWrapperValve.invoke( > StandardWrapperValve.java:220) > at > org.apache.catalina.core.StandardContextValve.invoke( > StandardContextValve.java:122) > at > org.apache.catalina.authenticator.AuthenticatorBase.invoke( > AuthenticatorBase.java:505) > at > org.apache.catalina.core.StandardHostValve.invoke( > StandardHostValve.java:169) > at > org.apache.catalina.valves.ErrorReportValve.invoke( > ErrorReportValve.java:103) > at > org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) > at > org.apache.catalina.core.StandardEngineValve.invoke( > StandardEngineValve.java:116) > at > org.apache.catalina.connector.CoyoteAdapter.service( > CoyoteAdapter.java:436) > at > org.apache.coyote.http11.AbstractHttp11Processor.process( > AbstractHttp11Processor.java:1078) > at > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler. > process(AbstractProtocol.java:625) > at > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor. > run(JIoEndpoint.java:318) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at > org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run( > TaskThread.java:61) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NoClassDefFoundError: > org/apache/spark/api/java/function/PairFunction > at > org.apache.kylin.engine.spark.SparkBatchCubingJobBuilder2. > addLayerCubingSteps(SparkBatchCubingJobBuilder2.java:48) > at > org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build( > BatchCubingJobBuilder2.java:66) > at > org.apache.kylin.engine.spark.SparkBatchCubingEngine2. > createBatchCubingJob(SparkBatchCubingEngine2.java:30) > at > org.apache.kylin.engine.EngineFactory.createBatchCubingJob( > EngineFactory.java:56) > at > org.apache.kylin.rest.service.JobService.submitJobInternal( > JobService.java:238) > at org.apache.kylin.rest.service.JobService.submitJob( > JobService.java:208) > at > org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$ > 83a44b2a.invoke() > at org.springframework.cglib.proxy.MethodProxy.invoke( > MethodProxy.java:204) > at > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation. > invokeJoinpoint(CglibAopProxy.java:720) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:157) > at > org.springframework.security.access.intercept.aopalliance. > MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > ReflectiveMethodInvocation.java:179) > at > org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor= . > intercept(CglibAopProxy.java:655) > at > org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$ > 39b3ce22.submitJob() > at > org.apache.kylin.rest.controller.CubeController. > buildInternal(CubeController.java:302) > ... 77 more > Caused by: java.lang.ClassNotFoundException: > org.apache.spark.api.java.function.PairFunction > at > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > WebappClassLoaderBase.java:1858) > at > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > WebappClassLoaderBase.java:1701) > ... 92 more > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/KYLIN2-1-tp8782.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > --001a113784704e2a6a055774e416--