Return-Path: X-Original-To: apmail-kylin-user-archive@minotaur.apache.org Delivered-To: apmail-kylin-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B70521927F for ; Thu, 14 Apr 2016 02:13:26 +0000 (UTC) Received: (qmail 53291 invoked by uid 500); 14 Apr 2016 02:13:26 -0000 Delivered-To: apmail-kylin-user-archive@kylin.apache.org Received: (qmail 53243 invoked by uid 500); 14 Apr 2016 02:13:26 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 53223 invoked by uid 99); 14 Apr 2016 02:13:26 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Apr 2016 02:13:26 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 185FBC0D53; Thu, 14 Apr 2016 02:13:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.998 X-Spam-Level: * X-Spam-Status: No, score=1.998 tagged_above=-999 required=6.31 tests=[HTML_FONT_LOW_CONTRAST=0.001, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id HCw7IG2RoDSi; Thu, 14 Apr 2016 02:13:22 +0000 (UTC) Received: from iflytek.com (mail.iflytek.com [36.7.172.15]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 5BD425F1AE; Thu, 14 Apr 2016 02:13:17 +0000 (UTC) Received: from jyzhengpc (unknown [192.168.19.75]) by coremail2 (Coremail) with SMTP id KWQQrAAnScGb_A5XklsGAA--.9126S3; Thu, 14 Apr 2016 10:12:43 +0800 (CST) From: "jyzheng" To: , Subject: Precise distinct count meet NumberFormatException Date: Thu, 14 Apr 2016 10:11:25 +0800 Message-ID: <005301d195f2$f2e51a20$d8af4e60$@iflytek.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0054_01D19636.01094480" X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdGV8iLUKpcUHH50TbiNmBuYIOhuxw== Content-Language: zh-cn X-CM-TRANSID: KWQQrAAnScGb_A5XklsGAA--.9126S3 X-Coremail-Antispam: 1UD129KBjvJXoW7WF1UJF4rCr48Xr13Jr4rAFb_yoW8uFy8p3 9Iyr1Igw4xZw4Ygrn0v3y7KFsxGwn5Kay7Ja1UJryjvF15Cry5Zw40k3Z29ryxX34kW3W7 C3ZFqw45WFsxAFDanT9S1TB71UUUUUUqnTZGkaVYY2UrUUUUjbIjqfuFe4nvWSU5nxnvy2 9KBjDU0xBIdaVrnUUvcSsGvfC2KfnxnUUI43ZEXa7xR_UUUUUUUUU== X-CM-SenderInfo: xm12xvlqj6xw5o1wvyoofrz/1tbiAQAFBFN2Tsz4IgABs8 This is a multipart message in MIME format. ------=_NextPart_000_0054_01D19636.01094480 Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: quoted-printable I upgrad kylin to 1.5.1 version. When I build cube meet this exception: = =20 The input hive table is orc file, and uid is bigint. The Hivesql = =A1=B0"select * from sdk_log where uid =3D 2627100446" return the expected result. 2016-04-14 09:25:11,730 ERROR [IPC Server handler 2 on 49399] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1452760018394_272831_m_000001_1 - exited : java.lang.NumberFormatException: For input string: "2627100446" at java.lang.NumberFormatException.forInputString(NumberFormatException.java= :65 ) at java.lang.Integer.parseInt(Integer.java:495) at java.lang.Integer.parseInt(Integer.java:527) at org.apache.kylin.measure.bitmap.BitmapCounter.add(BitmapCounter.java:63) at org.apache.kylin.measure.bitmap.BitmapMeasureType$1.valueOf(BitmapMeasure= Typ e.java:106) at org.apache.kylin.measure.bitmap.BitmapMeasureType$1.valueOf(BitmapMeasure= Typ e.java:98) at org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildValueOf(BaseCu= boi dMapperBase.java:189) at org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildValue(BaseCubo= idM apperBase.java:159) at org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboid= Map perBase.java:206) at org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCub= oid Mapper.java:53) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at = org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation= .ja va:1671) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) =20 -------------------------------- =D6=A3=BD=AD=D3=EA =D4=C6=C6=BD=CC=A8 Phone: 15155195496 =20 ------=_NextPart_000_0054_01D19636.01094480 Content-Type: text/html; charset="gb2312" Content-Transfer-Encoding: quoted-printable

I upgrad = kylin to 1.5.1 version. When I build cube meet this exception: =  

 

The = input hive table is orc file, and uid is bigint. The Hivesql = =A1=B0"select * from sdk_log where uid =3D 2627100446" return = the expected result.

2016-04-14 = 09:25:11,730 ERROR [IPC Server handler 2 on 49399] = org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: = attempt_1452760018394_272831_m_000001_1 - exited : = java.lang.NumberFormatException: For input string: = "2627100446"

  &= nbsp;    at = java.lang.NumberFormatException.forInputString(NumberFormatException.java= :65)

  &= nbsp;    at = java.lang.Integer.parseInt(Integer.java:495)

  &= nbsp;    at = java.lang.Integer.parseInt(Integer.java:527)

  &= nbsp;    at = org.apache.kylin.measure.bitmap.BitmapCounter.add(BitmapCounter.java:63)<= o:p>

  &= nbsp;    at = org.apache.kylin.measure.bitmap.BitmapMeasureType$1.valueOf(BitmapMeasure= Type.java:106)

  &= nbsp;    at = org.apache.kylin.measure.bitmap.BitmapMeasureType$1.valueOf(BitmapMeasure= Type.java:98)

  &= nbsp;    at = org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildValueOf(BaseCu= boidMapperBase.java:189)

  &= nbsp;    at = org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.buildValue(BaseCubo= idMapperBase.java:159)

  &= nbsp;    at = org.apache.kylin.engine.mr.steps.BaseCuboidMapperBase.outputKV(BaseCuboid= MapperBase.java:206)

  &= nbsp;    at = org.apache.kylin.engine.mr.steps.HiveToBaseCuboidMapper.map(HiveToBaseCub= oidMapper.java:53)

  &= nbsp;    at = org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)=

  &= nbsp;    at = org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)

  &= nbsp;    at = org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)<= /p>

  &= nbsp;    at = org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)

  &= nbsp;    at = java.security.AccessController.doPrivileged(Native = Method)

  &= nbsp;    at = javax.security.auth.Subject.doAs(Subject.java:415)

<= p class=3DMsoNormal align=3Dleft = style=3D'margin-bottom:7.5pt;text-align:left;background:black;word-break:= break-all;border:none;padding:0cm'>  &= nbsp;    at = org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation= .java:1671)

  &= nbsp;    at = org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

 

--------------------------------

=D6=A3=BD=AD=D3=EA  =D4=C6=C6=BD=CC=A8

Phone: = 15155195496

 

------=_NextPart_000_0054_01D19636.01094480--