kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dan Burkert <...@cloudera.com>
Subject Re: Create encoded columns in kudu
Date Wed, 21 Sep 2016 17:29:47 GMT
On Wed, Sep 21, 2016 at 7:53 AM, Jean-Daniel Cryans <jdcryans@apache.org>
wrote:

> Hi Amit,
>
> There's this jira on the Impala side: https://issues.cloudera.
> org/browse/IMPALA-3726
>
> I don't know exactly when it'll be available, but I think it's being
> looked at.
>
> Dan Burkert also has a Rust shell for Kudu somewhere, I'll let him comment
> about it.
>

Yes, there is an experimental shell called kudusql
<https://github.com/danburkert/kudusql> that can create tables with column
encoding and compression:

kudu> show tables;
Table | ID
------+---------------------------------
s     | 783e6d7003e74db28b272349fb16a959
t     | 757e4d14c1aa4af1a85cd0983c512359

kudu> CREATE TABLE with_encoding (
    a INT32 NOT NULL ENCODING bitshuffle,
    PRIMARY KEY (a)
) DISTRIBUTE BY HASH (a) INTO 4 BUCKETS
WITH 1 REPLICA;
table created

kudu> SHOW TABLES;
Table         | ID
--------------+---------------------------------
with_encoding | 584424c61d614dec8e75f9868620a72f
s             | 783e6d7003e74db28b272349fb16a959
t             | 757e4d14c1aa4af1a85cd0983c512359

kudu> DESCRIBE TABLE WITH_ENCODING;
error: Master(MasterError { code: TableNotFound, status: NotFound: The
table does not exist: table_name: "WITH_ENCODING" })

kudu> DESCRIBE TABLE with_encoding;
Column | Type  | Nullable | Encoding   | Compression
-------+-------+----------+------------+------------
a      | Int32 | False    | BitShuffle | Default

kudusql is very experimental at the moment, and I do not recommend pointing
it at a production cluster.

- Dan



>
> J-D
>
> On Wed, Sep 21, 2016 at 5:36 AM, Amit Adhau <amit.adhau@globant.com>
> wrote:
>
>> Hi kudu Team,
>>
>> Is there a direct way apart from api, to add the encoding for the kudu
>> table columns, e.g. in Create table statement which we run on impala shell,
>> can we specify the dictionary encoding?
>>
>> --
>> Thanks & Regards,
>>
>> *Amit Adhau* | Data Architect
>>
>> *GLOBANT* | IND:+91 9821518132
>>
>> [image: Facebook] <https://www.facebook.com/Globant>
>>
>> [image: Twitter] <http://www.twitter.com/globant>
>>
>> [image: Youtube] <http://www.youtube.com/Globant>
>>
>> [image: Linkedin] <http://www.linkedin.com/company/globant>
>>
>> [image: Pinterest] <http://pinterest.com/globant/>
>>
>> [image: Globant] <http://www.globant.com/>
>>
>> The information contained in this e-mail may be confidential. It has been
>> sent for the sole use of the intended recipient(s). If the reader of this
>> message is not an intended recipient, you are hereby notified that any
>> unauthorized review, use, disclosure, dissemination, distribution or
>> copying of this communication, or any of its contents,
>> is strictly prohibited. If you have received it by mistake please let us
>> know by e-mail immediately and delete it from your system. Many thanks.
>>
>>
>>
>> La información contenida en este mensaje puede ser confidencial. Ha sido
>> enviada para el uso exclusivo del destinatario(s) previsto. Si el lector de
>> este mensaje no fuera el destinatario previsto, por el presente queda Ud.
>> notificado que cualquier lectura, uso, publicación, diseminación,
>> distribución o copiado de esta comunicación o su contenido está
>> estrictamente prohibido. En caso de que Ud. hubiera recibido este mensaje
>> por error le agradeceremos notificarnos por e-mail inmediatamente y
>> eliminarlo de su sistema. Muchas gracias.
>>
>>
>

Mime
View raw message