Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1FE03200D1F for ; Fri, 13 Oct 2017 21:23:57 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1E576160BE6; Fri, 13 Oct 2017 19:23:57 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3C6031609CA for ; Fri, 13 Oct 2017 21:23:56 +0200 (CEST) Received: (qmail 98455 invoked by uid 500); 13 Oct 2017 19:23:55 -0000 Mailing-List: contact user-help@kudu.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kudu.apache.org Delivered-To: mailing list user@kudu.apache.org Received: (qmail 98443 invoked by uid 99); 13 Oct 2017 19:23:55 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Oct 2017 19:23:55 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4C80C180B42 for ; Fri, 13 Oct 2017 19:23:54 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.382 X-Spam-Level: ** X-Spam-Status: No, score=2.382 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, HTML_OBFUSCATE_05_10=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id VJ1jZ6OFdE4n for ; Fri, 13 Oct 2017 19:23:52 +0000 (UTC) Received: from mail-qt0-f169.google.com (mail-qt0-f169.google.com [209.85.216.169]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 25A625F3E2 for ; Fri, 13 Oct 2017 19:23:52 +0000 (UTC) Received: by mail-qt0-f169.google.com with SMTP id f15so21498012qtf.7 for ; Fri, 13 Oct 2017 12:23:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=wQZYscVvUEp9o6kjeVrA8ZeCn9qIa1U9HHQt8NduwiY=; b=sn9yBua87hYNgUT+3DyW1zi+skmhFXDuGRPwF2aE7VhI2jGTRgcXEed7SnfaD6CiJd PE05i0XdpD3i6a5tvVIp9HaLI41Tsklr8j3xcdLPod9Jf+xVXXxXpBNqAod3qDhNbCS4 Es0fYh4JZ4KIx4fjhspvIHAIG1qfiSv53zzSKS86SjJLL3n7wob+2UiUphacOfZy9KzC NyYq4Mtr/afv5XBUMtzjjMjC3Pkyh2XX0WHA2PBtCl3CuPNZ84w1C1V99+ZPN+ifqPB7 Vsa60RbGwgD9t1TTutyebEV846e+wHX0H4G4Yh5s7n1PtnWWD7c05zBOO1gnFGE1/+FS yWRA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=wQZYscVvUEp9o6kjeVrA8ZeCn9qIa1U9HHQt8NduwiY=; b=UmCj/brtyYUwOkkPKYtRnTXajxoYgbTIjzEZBzssoQYgJUv5vcVRMjyEZo4fyHLKwA smTRtEfJDaFGnzRvpO7BulyEUOb6tzzYwn4CDZZsgGEbEeGtPtEMrVilfpQlrgQgjw8p vjWiRNo7oQEkuAx0dfz0hjNk/oRXfS7EC4tGTKv7II/b3yT1qKnb1gJC8F2iEkwjUgbp 2sshQy2NWrSJuOfXKHg3Wcu6O8R+uebud2/8lHqvJUzeQT8gHzZyQWosmeSQtQ13PG3H gk1uIlWKSufshw/1O3kyUvd43iosdjlN2ClywEVht1DTlHfqqSOo2SvQwxO36byxFhEU JQ+w== X-Gm-Message-State: AMCzsaUSY8OCsarzyhwGfK4lGm9CsPYDSg2ewCxACURsc0MdP1qNcAJi XtlUfwncArRlW7ELhBsquuB+9qx5zhlMDbaLGYM= X-Google-Smtp-Source: AOwi7QDI7eNC59eChyiWPVrpmuPEFE6fbCG5cF1WHoUzFBH+3eYa6rqGwvelBnE+2NHtqJwU4h98PPltTI4d+VghoJo= X-Received: by 10.200.8.239 with SMTP id y44mr3768931qth.341.1507922630834; Fri, 13 Oct 2017 12:23:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.140.102.23 with HTTP; Fri, 13 Oct 2017 12:23:50 -0700 (PDT) In-Reply-To: References: From: Nitin Agarwal <2nitinagarwal@gmail.com> Date: Fri, 13 Oct 2017 13:23:50 -0600 Message-ID: Subject: Re: Unable to access Kudu table created using Spark via Impala To: user@kudu.apache.org Content-Type: multipart/alternative; boundary="001a1144b42ec280a9055b7298a8" archived-at: Fri, 13 Oct 2017 19:23:57 -0000 --001a1144b42ec280a9055b7298a8 Content-Type: text/plain; charset="UTF-8" Thanks Alexey, that did the trick. Nitin On Fri, Oct 13, 2017 at 1:15 PM, Alexey Serbin wrote: > Hi Nitin, > > Impala needs to know about Kudu tables which were created 'externally' > (i.e. not via Impala). Have you run that 'CREATE EXTERNAL TABLE ...' via > Impala shell already? If not, you need to do so. More information on the > topic can be found at: > http://kudu.apache.org/docs/kudu_impala_integration.html#_qu > erying_an_existing_kudu_table_in_impala > > > Best regards, > > Alexey > > > On 10/13/17 12:10 PM, Nitin Agarwal wrote: > >> Hi, I used Spark and KuduContext to create a table in Kudu. I can see the >> table in Kudu UI and can access it through Spark. However I am unable to >> access that table via Impala. I have issued invalidate metadata in Impala >> but I am still unable to list the table. >> >> So what do I need to do to access this table via Impala? >> >> I am using Kudu version kudu 1.4.0-cdh5.12.1 with Spark 1.6.x >> >> This is what I see in Kudu UI for my table >> >> |CREATE EXTERNAL TABLE `nums.telephone_number` STORED AS KUDU >> TBLPROPERTIES( 'kudu.table_name' = 'nums.telephone_number', >> 'kudu.master_addresses' = 'ff58-29.idc1.level3.com:7051 < >> http://ff58-29.idc1.level3.com:7051>,ff58-30.idc1.level3.com:7051 < >> http://ff58-30.idc1.level3.com:7051>,ff58-34.idc1.level3.com:7051');| >> |Nitin| >> > > --001a1144b42ec280a9055b7298a8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thanks Alexey, that did the trick.=C2=A0

Nitin

On Fri, Oct 13, 2017 at 1:15 PM, Alexey Serbin <aserbin@cloudera.com<= /a>> wrote:
Hi Nitin,

Impala needs to know about Kudu tables which were created 'externally&#= 39; (i.e. not via Impala).=C2=A0 Have you run that 'CREATE EXTERNAL TAB= LE ...' via Impala shell already?=C2=A0 If not, you need to do so.=C2= =A0 More information on the topic can be found at:
h= ttp://kudu.apache.org/docs/kudu_impala_integration.html#_querying= _an_existing_kudu_table_in_impala


Best regards,

Alexey


On 10/13/17 12:10 PM, Nitin Agarwal wrote:
Hi, I used Spark and KuduContext to create a table in Kudu. I can see the t= able in Kudu UI and can access it through Spark. However I am unable to acc= ess that table via Impala. I have issued invalidate metadata in Impala but = I am still unable to list the table.

So what do I need to do to access this table via Impala?

I am using Kudu version kudu 1.4.0-cdh5.12.1 with Spark 1.6.x

This is what I see in Kudu UI for my table

|CREATE EXTERNAL TABLE `nums.telephone_number` STORED AS KUDU TBLPROPERTIES= ( 'kudu.table_name' =3D 'nums.telephone_number', 'kudu.= master_addresses' =3D 'ff58-29.idc1.level3.com:7051 &= lt;http://ff58-29.idc1.level3.com:7051>,ff5= 8-30.idc1.level3.com:7051 <http://ff58-30.idc1.level3= .com:7051>,ff58-34.id= c1.level3.com:7051');|
|Nitin|


--001a1144b42ec280a9055b7298a8--