From user-return-1253-archive-asf-public=cust-asf.ponee.io@kudu.apache.org Fri Feb 9 18:04:05 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 6DF0D180654 for ; Fri, 9 Feb 2018 18:04:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 5D6F7160C4C; Fri, 9 Feb 2018 17:04:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D54DA160C2E for ; Fri, 9 Feb 2018 18:04:03 +0100 (CET) Received: (qmail 42316 invoked by uid 500); 9 Feb 2018 17:04:02 -0000 Mailing-List: contact user-help@kudu.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kudu.apache.org Delivered-To: mailing list user@kudu.apache.org Delivered-To: moderator for user@kudu.apache.org Received: (qmail 64009 invoked by uid 99); 9 Feb 2018 08:01:38 -0000 X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.978 X-Spam-Level: * X-Spam-Status: No, score=1.978 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=talend365.onmicrosoft.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=talend365.onmicrosoft.com; s=selector1-talend-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=9lQVYXYoy/RtlK7JAXfZI8DmcRYMq646J+zkkvoiHe8=; b=KvF65s1yJGUPzzJubMTaP4ThMdyQmfkO2TOE3f6vX1Hqt51FblQpi+ycIqYsu+ru0wO/Tdx2zVvLt1yc1cpXNqwYs7gS0XZHMm5MH6cSdfbV6yWD9MonoNW59/cos2A0J2+EoladRTohBNp/AqtGTmW3SMt54cIqAOQ8tfBcIbE= From: Zakaria Afkir To: "user@kudu.apache.org" Subject: TR: Cannot create Kudu table with Range Partitioning Thread-Topic: Cannot create Kudu table with Range Partitioning Thread-Index: AdOhe4lmFCLzAGdLRuy7AFK0JmZVwAAAJ0Lw Date: Fri, 9 Feb 2018 08:01:26 +0000 Message-ID: References: In-Reply-To: Accept-Language: fr-FR, en-US Content-Language: fr-FR X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=zafkir@talend.com; x-originating-ip: [84.14.92.154] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;BN6PR1201MB0034;7:UKZCC+8LO6UINFnlVBuhXpqeP/K0ghaDVSIqq4zewlfQnwfiYOZ4pidIgzmoUdUPXdZ1Unz+K/9k3KiwJaar/DnZ0QQIi7b4pIWBNwvf/qPOaL3Slt3d20f5JAO3gpx5/rVnXOfNqxzyHwIMfr6jNXo62NfHsNs8zZF7tdmzc6DyH1zemfWdWZj5OLK08a03AhbeupkbxrtI38ah5xcA5kDzzT8g4e8LwuS+sWxWjK8wf3SyfWKqVpWz9RBSRT0/ x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 53140fab-bfe7-4e37-7193-08d56f935190 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(5600026)(4604075)(3008032)(2017052603307)(7153060)(7193020);SRVR:BN6PR1201MB0034; x-ms-traffictypediagnostic: BN6PR1201MB0034: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(6040501)(2401047)(5005006)(8121501046)(3231101)(2400082)(944501161)(10201501046)(93006095)(93001095)(3002001)(6041288)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(20161123560045)(20161123558120)(20161123562045)(6072148)(201708071742011);SRVR:BN6PR1201MB0034;BCL:0;PCL:0;RULEID:;SRVR:BN6PR1201MB0034; x-forefront-prvs: 057859F9C5 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(366004)(39380400002)(39860400002)(376002)(346002)(396003)(199004)(189003)(74316002)(68736007)(6436002)(55236004)(2906002)(3660700001)(76176011)(7736002)(2950100002)(6916009)(5660300001)(97736004)(1730700003)(102836004)(3280700002)(77096007)(2501003)(86362001)(66066001)(186003)(81156014)(99286004)(8676002)(33656002)(81166006)(2351001)(2900100001)(26005)(105586002)(316002)(8936002)(2940100002)(6116002)(25786009)(3846002)(790700001)(53936002)(55016002)(6306002)(54896002)(9686003)(14454004)(106356001)(6506007)(7696005)(5640700003)(478600001);DIR:OUT;SFP:1102;SCL:1;SRVR:BN6PR1201MB0034;H:BN6PR1201MB2465.namprd12.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; received-spf: None (protection.outlook.com: talend.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: O5SoGbLnxOhPZquotK6TRZHMN1Tjglp0gnw3jxW29auc4FBMe0QlFfLeaGL1WHyq+ej2Lg36pO8MuQruUAEOAQ== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_BN6PR1201MB24651A3F1DF6C9A7EA1F55ECAEF20BN6PR1201MB2465_" MIME-Version: 1.0 X-OriginatorOrg: talend.com X-MS-Exchange-CrossTenant-Network-Message-Id: 53140fab-bfe7-4e37-7193-08d56f935190 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Feb 2018 08:01:26.1308 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 0333ca35-3f21-4f69-abef-c46d541d019d X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR1201MB0034 --_000_BN6PR1201MB24651A3F1DF6C9A7EA1F55ECAEF20BN6PR1201MB2465_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable De : Zakaria Afkir Envoy=E9 : vendredi 9 f=E9vrier 2018 08:59 =C0 : 'issues@kudu.apache.org' Objet : Cannot create Kudu table with Range Partitioning Hello, I'm using Kudu-spark2_2.11-1.4.0-cdh5.12.1.jar and I get an error when crea= ting a table with range partitioning and the table doesn't exist. The code to create Kudu table with range partitioning: java.util.ArrayList columns =3D new java.util= .ArrayList<>(); columns.add(new org.apache.kudu.ColumnSchema.ColumnSchemaBuilder("name", or= g.apache.kudu.Type.STRING).nullable(false).key(true).build()); org.apache.kudu.Schema schema =3D new org.apache.kudu.Schema(columns); org.apache.kudu.client.PartialRow lower =3D schema.newPartialRow(); lower.addString("name", "a"); columns =3D new java.util.ArrayList<>(); columns.add(new org.apache.kudu.ColumnSchema.ColumnSchemaBuilder("name", or= g.apache.kudu.Type.STRING).nullable(false).key(true).build()); schema =3D new org.apache.kudu.Schema(columns); org.apache.kudu.client.PartialRow upper =3D schema.newPartialRow(); upper.addString("name", "z"); kuduCtx_tKuduOutput_1.createTable("table2", types_row1, keys_row1, new org.= apache.kudu.client.CreateTableOptions() .addHashPartitions(java.util.Arrays.asList("name"), 2) .addRangePartition(lower, upper) .setRangePartitionColumns(java.util.Arrays.asList("name")) .setNumReplicas(1)); And the error: [ERROR]: local_project.sparkwithtkuduoutput_0_1.SparkWithtKuduOutput - tKud= uOutput_1 - Bad indirect slice org.apache.kudu.client.NonRecoverableException: The table does not exist: t= able_name: "table2" at org.apache.kudu.client.TabletClient.dispatchMasterErrorOrReturnException= (TabletClient.java:557) at org.apache.kudu.client.TabletClient.messageReceived(TabletClient.java:46= 7) at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstr= eamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.TabletClient.handleUpstream(TabletClient.java:603= ) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:564) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:= 791) at org.apache.kudu.client.shaded.org.jboss.netty.handler.timeout.ReadTimeou= tHandler.messageReceived(ReadTimeoutHandler.java:184) at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstr= eamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:564) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:= 791) at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireMessa= geReceived(Channels.java:296) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.oneone.OneTo= OneDecoder.handleUpstream(OneToOneDecoder.java:70) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:564) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:= 791) at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireMessa= geReceived(Channels.java:296) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.callDecode(FrameDecoder.java:443) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.messageReceived(FrameDecoder.java:303) at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstr= eamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:564) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:= 791) at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireMessa= geReceived(Channels.java:296) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.callDecode(FrameDecoder.java:443) at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameD= ecoder.messageReceived(FrameDecoder.java:303) at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstr= eamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:564) at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipe= line.sendUpstream(DefaultChannelPipeline.java:559) at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireMessa= geReceived(Channels.java:268) at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireMessa= geReceived(Channels.java:255) at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.NioWork= er.read(NioWorker.java:88) at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.Abstrac= tNioWorker.process(AbstractNioWorker.java:108) at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.Abstrac= tNioSelector.run(AbstractNioSelector.java:337) at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.Abstrac= tNioWorker.run(AbstractNioWorker.java:89) at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.NioWork= er.run(NioWorker.java:178) at org.apache.kudu.client.shaded.org.jboss.netty.util.ThreadRenamingRunnabl= e.run(ThreadRenamingRunnable.java:108) at org.apache.kudu.client.shaded.org.jboss.netty.util.internal.DeadLockProo= fWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Thanks, Best regards --_000_BN6PR1201MB24651A3F1DF6C9A7EA1F55ECAEF20BN6PR1201MB2465_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

 

 

De : Zakaria Afkir
Envoy=E9 : vendredi 9 f=E9vrier 2018 08:59
=C0 : 'issues@kudu.apache.org' <issues@kudu.apache.org> Objet : Cannot create Kudu table with Range Partitioning

 

Hello,

I'm using Kudu-spark2_2.11-1.4.0-cdh5.12.1.jar and I get an error when crea= ting a table with range partitioning and the table doesn't exist.=

The code to create Kudu table with range partitioning:

java.util.Ar= rayList<org.apache.kudu.ColumnSchema> columns =3D new java.util.ArrayList<>();=

columns.add(= new org.apache.kudu.ColumnSchema.ColumnSchemaBuilder("name= ", org.apache.kudu.Type.STRING).nullable(false).key(true).build());

org.apache.k= udu.Schema schema =3D new org.apache.kudu.Schema(columns);

org.apache.k= udu.client.PartialRow lower =3D schema.newPartialRow();

lower.addStr= ing("name", "a");

 <= /o:p>

columns =3D new java.util.ArrayList<>();=

columns.add(= new org.apache.kudu.ColumnSchema.ColumnSchemaBuilder("name= ", org.apache.kudu.Type.STRING).nullable(false).key(true).build());

schema =3D new org.apache.kudu.Schema(columns);

org.apache.k= udu.client.PartialRow upper =3D schema.newPartialRow();

upper.addString("name", "z");

kuduCtx_tKud= uOutput_1.createTable("table2", types_row1, keys_row1, new org.apache.kudu.c= lient.CreateTableOptions()

.addHashPart= itions(java.util.Arrays.asList("name".addRangePar= tition(lower, upper)

.setRangePar= titionColumns(java.util.Arrays.asList("name"))

.setNumRepli= cas(1));

 

And the error:

 

[ERROR]: local_project.sparkwithtkuduoutput_0_1.SparkWithtKuduOutpu=
t - tKuduOutput_1 - Bad indirect slice
org.apache.kudu.client.NonRecoverableException: The table does not =
exist: table_name: "table2"
at org.apache.kudu.client.TabletClient.dispatchMasterErrorOrReturnE=
xception(TabletClient.java:557)
at org.apache.kudu.client.TabletClient.messageReceived(TabletClient=
.java:467)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChan=
nelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.apache.kudu.client.TabletClient.handleUpstream(TabletClient.=
java:603)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeli=
ne.java:791)
at org.apache.kudu.client.shaded.org.jboss.netty.handler.timeout.Re=
adTimeoutHandler.messageReceived(ReadTimeoutHandler.java:184)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChan=
nelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeli=
ne.java:791)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.f=
ireMessageReceived(Channels.java:296)
at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.oneo=
ne.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:70)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeli=
ne.java:791)
at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.f=
ireMessageReceived(Channels.java:296)
at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.messageReceived(FrameDecoder.java:303)

at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChan=
nelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:564)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeli=
ne.java:791)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.f=
ireMessageReceived(Channels.java:296)


at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)


at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.callDecode(FrameDecoder.java:443)


at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.fram=
e.FrameDecoder.messageReceived(FrameDecoder.java:303)

at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChan=
nelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:564)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultCha=
nnelPipeline.sendUpstream(DefaultChannelPipeline.java:559)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.f=
ireMessageReceived(Channels.java:268)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.f=
ireMessageReceived(Channels.java:255)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio=
.NioWorker.read(NioWorker.java:88)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio=
.AbstractNioWorker.process(AbstractNioWorker.java:108)

at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio=
.AbstractNioSelector.run(AbstractNioSelector.java:337)

at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio=
.AbstractNioWorker.run(AbstractNioWorker.java:89)


at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio=
.NioWorker.run(NioWorker.java:178)


at org.apache.kudu.client.shaded.org.jboss.netty.util.ThreadRenamin=
gRunnable.run(ThreadRenamingRunnable.java:108)


at org.apache.kudu.client.shaded.org.jboss.netty.util.internal.Dead=
LockProofWorker$1.run(DeadLockProofWorker.java:42)


at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source=
)


at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Sourc=
e)


at java.lang.Thread.run(Unknown Source)




Thanks,



Best regards
--_000_BN6PR1201MB24651A3F1DF6C9A7EA1F55ECAEF20BN6PR1201MB2465_--