Return-Path: X-Original-To: apmail-kudu-user-archive@minotaur.apache.org Delivered-To: apmail-kudu-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5F5FF18DB2 for ; Mon, 18 Apr 2016 15:07:57 +0000 (UTC) Received: (qmail 95490 invoked by uid 500); 18 Apr 2016 15:07:57 -0000 Delivered-To: apmail-kudu-user-archive@kudu.apache.org Received: (qmail 95450 invoked by uid 500); 18 Apr 2016 15:07:57 -0000 Mailing-List: contact user-help@kudu.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kudu.incubator.apache.org Delivered-To: mailing list user@kudu.incubator.apache.org Received: (qmail 95442 invoked by uid 99); 18 Apr 2016 15:07:57 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Apr 2016 15:07:57 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 1B8871A0053 for ; Mon, 18 Apr 2016 15:07:57 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -2.021 X-Spam-Level: X-Spam-Status: No, score=-2.021 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 2M9-CXwONmMq for ; Mon, 18 Apr 2016 15:07:55 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with SMTP id 90C455F5A1 for ; Mon, 18 Apr 2016 15:07:53 +0000 (UTC) Received: (qmail 95427 invoked by uid 99); 18 Apr 2016 15:07:52 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Apr 2016 15:07:52 +0000 Received: from mail-qg0-f50.google.com (mail-qg0-f50.google.com [209.85.192.50]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 8F4861A0113 for ; Mon, 18 Apr 2016 15:07:52 +0000 (UTC) Received: by mail-qg0-f50.google.com with SMTP id v14so27156734qge.0 for ; Mon, 18 Apr 2016 08:07:52 -0700 (PDT) X-Gm-Message-State: AOPr4FUcY5CKHiYkMAsJ6Z65SwFf4BHlulYlsMurZsuh3e6q95rTaHzln1AUoqHiU1m/Ue+asqhsRCggOfGtDg== MIME-Version: 1.0 X-Received: by 10.140.90.106 with SMTP id w97mr44626833qgd.14.1460992071647; Mon, 18 Apr 2016 08:07:51 -0700 (PDT) Received: by 10.55.179.5 with HTTP; Mon, 18 Apr 2016 08:07:51 -0700 (PDT) In-Reply-To: References: Date: Mon, 18 Apr 2016 08:07:51 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: impala got duplicate fields after compute stats on kudu table From: Jean-Daniel Cryans To: user@kudu.incubator.apache.org Content-Type: multipart/alternative; boundary=001a11c11a24734dff0530c3b9cd --001a11c11a24734dff0530c3b9cd Content-Type: text/plain; charset=UTF-8 Hi Darren, Is this with Impala Kudu 0.8.0 or a previous version? Thx, J-D On Mon, Apr 18, 2016 at 7:29 AM, Darren Hoo wrote: > 1. create a kudu table to test > > > create table t2 ( > > id INT, > > cid INT > > ) > > TBLPROPERTIES( > > 'storage_handler' = 'com.cloudera.kudu.hive.KuduStorageHandler', > > 'kudu.table_name' = 't2', > > 'kudu.key_columns' = 'id', > > 'kudu.master_addresses' = 'master:7051' > > ); > > > > 2. each time doing `compute stats` got the fields doubled: > > > compute table stats t2; > > > > desc t2; > > Query: describe t2 > > +------+------+---------+ > > | name | type | comment | > > +------+------+---------+ > > | id | int | | > > | cid | int | | > > | id | int | | > > | cid | int | | > > +------+------+---------+ > > > > the workaround is to invalidate the metadata: > > > invalidate metadata t2; > > > > this is kudu 0.8.0 on cdh5.7 > --001a11c11a24734dff0530c3b9cd Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Darren,

Is this with Impala Kudu 0.8= .0 or a previous version?

Thx,

J-D

On Mon, Apr 18, 2016 at 7:29 AM, Darren Hoo <darren.hoo@gmail.com> wrote:

1.= create a kudu table =C2=A0to test


create table t2 (

=C2=A0 =C2=A0 id=C2=A0 INT,

=C2=A0 =C2=A0 cid INT

)

TBLPROPERTIES(

=C2=A0 'storage_handler' =3D 'com.cloudera.kudu.hive.Kud= uStorageHandler',

=C2=A0 'kudu.table_name' =3D 't2',

=C2=A0 'kudu.key_columns' =3D 'id',

=C2=A0 'kudu.master_addresses' =3D 'master:7051'

);



2. each time = doing `compute stats` got the fields doubled:


<= /p>

compute table stats t2;



desc t2;

Query: describe t2

+----= --+------+---------+

| name | type | comment |

<= p style=3D"margin:0px;font-size:11px;line-height:normal;font-family:Menlo">= +------+------+---------+

| id =C2=A0 | int=C2=A0 | = =C2=A0 =C2=A0 =C2=A0 =C2=A0 |

| cid=C2=A0 | int=C2=A0 | = =C2=A0 =C2=A0 =C2=A0 =C2=A0 |

| id =C2=A0 | int=C2=A0 | = =C2=A0 =C2=A0 =C2=A0 =C2=A0 |

| cid=C2=A0 | int=C2=A0 | = =C2=A0 =C2=A0 =C2=A0 =C2=A0 |

+------+------+---------+



<= /p>

the workaround is to invalidate the metadata:

<= br>

invalidate metadata t2;



t= his is kudu 0.8.0 on cdh5.7


--001a11c11a24734dff0530c3b9cd--