From user-return-4669-archive-asf-public=cust-asf.ponee.io@kylin.apache.org Fri Aug 30 04:39:08 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id CCF58180608 for ; Fri, 30 Aug 2019 06:39:07 +0200 (CEST) Received: (qmail 71568 invoked by uid 500); 30 Aug 2019 04:39:06 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 71549 invoked by uid 99); 30 Aug 2019 04:39:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Aug 2019 04:39:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 1508F1A4299; Fri, 30 Aug 2019 04:39:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.8 X-Spam-Level: * X-Spam-Status: No, score=1.8 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id MQg1pZrYqGT4; Fri, 30 Aug 2019 04:39:03 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.222.177; helo=mail-qk1-f177.google.com; envelope-from=hello123.cn@gmail.com; receiver= Received: from mail-qk1-f177.google.com (mail-qk1-f177.google.com [209.85.222.177]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 9ABBFBC7A9; Fri, 30 Aug 2019 04:39:03 +0000 (UTC) Received: by mail-qk1-f177.google.com with SMTP id f10so5068245qkg.7; Thu, 29 Aug 2019 21:39:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=oHuvh6nY8R+tH9KVi+3StWqbNjX5xTZeI5nJ5MzgouQ=; b=utGoYpfDiYcLzi1JRSKxlBhTSOsGiUajjuiidqvBnznG0N7T9suinDYviIR4B6Tmnv MS6S68xPdfd6MsKgwCadQ4hjhnftiuMNjaGxoQZNHARLmqWma0E14LvLiFScLJ36t2LX Wmlah+3tdWVzPmJ3IY/xYfkPXScBr0b/ksW32LqAiejh44cWQ22V9xM8VN+5FFkDehj5 qWlHTCl3JeWPclVOhzR1IAh1J0SJD4Yfnfa1VhPUDeRP6AXbNi0IlAb4YGmxDIEZb8p4 GPGkm8OlahpE5721FyMhh6Lthqq3bTyrloEqjPHBd3C8HSnU1dyAHIvEJ9ad2/e21/sG utyQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=oHuvh6nY8R+tH9KVi+3StWqbNjX5xTZeI5nJ5MzgouQ=; b=EbiE+S/a4p4F24S2pagkYNZJWFfpzTe7sV7EwPNxaZbDEpIoDG+wKTEF1NziT1KUUv vEI5Z7ChaiqKqmlZ9VRkb53a1YSaryzhuJj4EVt3sI/lj8rx4bFxYM6Q/X1ulSi0PwF+ RCtUcDecbWb897ZOnE2uVZMnpVX5Yg+YtpC/9+y9tjRD+ljbDbP7twzy2QuYytQWUNLP TZ+kIYwV55Irt4EjjWZ5TGbmruYyXxyNSW0cWh2KRBX/xu7YFQRsJP8xVkGtL/AgXDlq DcnTwSfSHBgpV4KFGqEjmb6dS7liwtqVza8fjNk6M8OT2wK6Zjnyh3A1B2CPJW2fi86Q WllQ== X-Gm-Message-State: APjAAAWvWOAjAiWuDR+NHFVz4gZYSymuZ3GCp0hn1q33457oa4sjk8Rp wcJVz725hpOGV2JQv4IkdUDrLOWD4VRQPdjXGO0hnrd5qy8= X-Google-Smtp-Source: APXvYqzQnCURqDnwX1qWBh8hiLJRYIAuKz2FgqU7HtTvoeaCxNKur84EkRCPIP9IHFbAzawltornhgfmKw+5CaHrLzE= X-Received: by 2002:a37:4c87:: with SMTP id z129mr14013758qka.205.1567139943001; Thu, 29 Aug 2019 21:39:03 -0700 (PDT) MIME-Version: 1.0 From: Alex Wang Date: Fri, 30 Aug 2019 12:38:27 +0800 Message-ID: Subject: Kylin truned on kerberos , Error execute MapReduceExecutable To: user@kylin.apache.org, dev@kylin.apache.org Content-Type: multipart/alternative; boundary="0000000000009db1c905914e33ce" --0000000000009db1c905914e33ce Content-Type: text/plain; charset="UTF-8" Hi ALL: Environment: kylin 1.6 Jdk: 1.8.0_74 Hadoop: 2.7.3 Hbase : 1.2.4 I turned on kerberos. Set kylin.job.status.with.kerberos=true klist info: Ticket cache: FILE:/tmp/krb5cc_500 > Default principal: kylin/hadoop1@XXXXXXX.CN > > Valid starting Expires Service principal > 08/30/2019 11:30:53 08/31/2019 11:30:53 krbtgt/XXXXXXX.CN@XXXXXXX.CN > renew until 09/05/2019 16:09:51 > then i start kylin , /bin/kylin.sh start When I build cube, kylin reports the following error, Can someone give me some advice? 2019-08-29 17:32:57,332 ERROR [pool-9-thread-2] > common.MapReduceExecutable:127 : error execute > MapReduceExecutable{id=7bf99a0e-8308-49e1-84ed-123bc9c49833-02, > name=Extract Fact Table Distinct Columns, state=RUNNING} > org.codehaus.jackson.map.exc.UnrecognizedPropertyException: Unrecognized > field "Token" (Class > org.apache.hadoop.yarn.api.records.timeline.TimelineDelegationTokenResponse), > not marked as ignorable > at [Source: N/A; line: -1, column: -1] (through reference chain: > org.apache.hadoop.yarn.api.records.timeline.TimelineDelegationTokenResponse["Token"]) > at > org.codehaus.jackson.map.exc.UnrecognizedPropertyException.from(UnrecognizedPropertyException.java:53) > at > org.codehaus.jackson.map.deser.StdDeserializationContext.unknownFieldException(StdDeserializationContext.java:267) > at > org.codehaus.jackson.map.deser.std.StdDeserializer.reportUnknownProperty(StdDeserializer.java:673) > at > org.codehaus.jackson.map.deser.std.StdDeserializer.handleUnknownProperty(StdDeserializer.java:659) > at > org.codehaus.jackson.map.deser.BeanDeserializer.handleUnknownProperty(BeanDeserializer.java:1365) > at > org.codehaus.jackson.map.deser.BeanDeserializer._handleUnknown(BeanDeserializer.java:725) > at > org.codehaus.jackson.map.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:703) > at > org.codehaus.jackson.map.deser.BeanDeserializer.deserialize(BeanDeserializer.java:580) > at org.codehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2704) > at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1999) > at > org.apache.hadoop.yarn.client.api.impl.TimelineAuthenticator.validateAndParseResponse(TimelineAuthenticator.java:222) > at > org.apache.hadoop.yarn.client.api.impl.TimelineAuthenticator.getDelegationToken(TimelineAuthenticator.java:114) > at > org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl.getDelegationToken(TimelineClientImpl.java:167) > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClientImpl.java:275) > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:221) > at > org.apache.hadoop.mapred.ResourceMgrDelegate.submitApplication(ResourceMgrDelegate.java:282) > at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:289) > at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) > at > org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:149) > at > org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:108) > at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) > at > org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113) > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113) > at > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > -- Best --0000000000009db1c905914e33ce Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi ALL:

Environment: kylin 1.6
Jdk: 1.= 8.0_74
Hadoop: 2.7.3
Hbase : 1.2.4

I turned on kerberos. Set k= ylin.job.status.with.kerberos=3Dtrue
klist=C2=A0 info:=C2=A0

Ticket cache: FIL= E:/tmp/krb5cc_500
Default principal: kylin/hadoop1@XXXXXXX.CN

Valid starting =C2=A0 =C2=A0 =C2=A0 = Expires =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Service principal08/30/2019 11:30:53 =C2=A008/31/2019 11:30:53 =C2=A0krbtgt/XXXXXXX.CN@XXXXXXX.CN
renew until 09/05/= 2019 16:09:51

then i start kylin , /bin= /kylin.sh start=C2=A0

When I build cube, kylin reports the following= error, Can someone give me some advice?

2019-08-29 17:32:57,332 ERROR [poo= l-9-thread-2] common.MapReduceExecutable:127 : error execute MapReduceExecu= table{id=3D7bf99a0e-8308-49e1-84ed-123bc9c49833-02, name=3DExtract Fact Tab= le Distinct Columns, state=3DRUNNING}
org.codehaus.jackson.map.exc.Unrec= ognizedPropertyException: Unrecognized field "Token" (Class org.a= pache.hadoop.yarn.api.records.timeline.TimelineDelegationTokenResponse), no= t marked as ignorable
=C2=A0at [Source: N/A; line: -1, column: -1] (thro= ugh reference chain: org.apache.hadoop.yarn.api.records.timeline.TimelineDe= legationTokenResponse["Token"])
at org.codehaus.jackson.map.e= xc.UnrecognizedPropertyException.from(UnrecognizedPropertyException.java:53= )
at org.codehaus.jackson.map.deser.StdDeserializationContext.unknownFi= eldException(StdDeserializationContext.java:267)
at org.codehaus.jackso= n.map.deser.std.StdDeserializer.reportUnknownProperty(StdDeserializer.java:= 673)
at org.codehaus.jackson.map.deser.std.StdDeserializer.handleUnknow= nProperty(StdDeserializer.java:659)
at org.codehaus.jackson.map.deser.B= eanDeserializer.handleUnknownProperty(BeanDeserializer.java:1365)
at or= g.codehaus.jackson.map.deser.BeanDeserializer._handleUnknown(BeanDeserializ= er.java:725)
at org.codehaus.jackson.map.deser.BeanDeserializer.deseria= lizeFromObject(BeanDeserializer.java:703)
at org.codehaus.jackson.map.d= eser.BeanDeserializer.deserialize(BeanDeserializer.java:580)
at org.cod= ehaus.jackson.map.ObjectMapper._readValue(ObjectMapper.java:2704)
at or= g.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1999)
a= t org.apache.hadoop.yarn.client.api.impl.TimelineAuthenticator.validateAndP= arseResponse(TimelineAuthenticator.java:222)
at org.apache.hadoop.yarn.= client.api.impl.TimelineAuthenticator.getDelegationToken(TimelineAuthentica= tor.java:114)
at org.apache.hadoop.yarn.client.api.impl.TimelineClientI= mpl.getDelegationToken(TimelineClientImpl.java:167)
at org.apache.hadoo= p.yarn.client.api.impl.YarnClientImpl.addTimelineDelegationToken(YarnClient= Impl.java:275)
at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl= .submitApplication(YarnClientImpl.java:221)
at org.apache.hadoop.mapred= .ResourceMgrDelegate.submitApplication(ResourceMgrDelegate.java:282)
at= org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:289)
at = org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.jav= a:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at = org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.= AccessController.doPrivileged(Native Method)
at javax.security.auth.Sub= ject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInfo= rmation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapre= duce.Job.submit(Job.java:1282)
at org.apache.kylin.engine.mr.common.Abs= tractHadoopJob.waitForCompletion(AbstractHadoopJob.java:149)
at org.apa= che.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob= .java:108)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92= )
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapRe= duceExecutable.java:120)
at org.apache.kylin.job.execution.AbstractExec= utable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.exe= cution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExec= utable.java:113)
at org.apache.kylin.job.impl.threadpool.DefaultSchedul= er$JobRunner.run(DefaultScheduler.java:136)
at java.util.concurrent.Thr= eadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.co= ncurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at = java.lang.Thread.run(Thread.java:748)

<= br>
--
Best
--0000000000009db1c905914e33ce--