kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: Re: KUDU INSERT SLOWLY
Date Thu, 24 Aug 2017 01:42:53 GMT
(putting dev@ in bcc again, please be mindful of which mailing list you
write to)

The best way would be to follow the "Batch insert" method described here:
http://kudu.apache.org/docs/kudu_impala_integration.html#kudu_impala_insert_bulk

J-D

On Wed, Aug 23, 2017 at 6:30 PM, sky <x_hsky@163.com> wrote:

> Thank you for your method.
> Is there any other way to quickly load text files into kudu table ?
>
>
>
>
>
>
>
>
> At 2017-08-22 16:12:47, "Balázs Jeszenszky" <balazsj@cloudera.com> wrote:
> >[dev@ to bcc]
> >
> >Hello,
> >
> >Setting up a query has some overhead (in query planning). I expect it
> >to be in the 100 ms range, multiplying that by 2k adds up to the time
> >you report.
> >Inserting all the values through one query would help.
> >
> >HTH
> >
> >On Tue, Aug 22, 2017 at 10:06 AM, sky <x_hsky@163.com> wrote:
> >> Hi all,
> >>     I do kudu insert sql  through the impala shell, it is very
> slowly.Approximately 4 minutes two thousand insert sqls. Is there any way
> to speed up kudu insert speed?
> >>     Command:
> >>         ./impala-shell.sh -f a.sql
> >>     a.sql:
> >>         insert into table t1 values("a1","b");
> >>         insert into table t1 valuse("a2","b");
> >>         ......
> >
> >
> >
> >--
> >Balázs Jeszenszky
> >Customer Operations Engineer
> >Email:   balazsj@cloudera.com
> >Data:    http://www.cloudera.com
>

Mime
View raw message