impala-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jim Apple <jbap...@cloudera.com>
Subject Re: IN impalad Between nodes data exchange consider using arrow to replace rowbatch
Date Wed, 23 Mar 2016 16:40:52 GMT
bcc:impala-user
+user@impala.incubator.apache.org

Some of these overheads are discussed in
https://issues.cloudera.org/browse/IMPALA-2682

On Wed, Mar 23, 2016 at 6:07 AM, zhang song <zsyuyizhang@gmail.com> wrote:

> You mean interaction between impala nodes? As far as i know , if we can
> utilize arrow(also from apache) as exchange middlware, maybe we can reduce
> the serialization and de-serialization time .
>
> 在 2016年3月23日星期三 UTC+8下午2:39:51,zhen写道:
>
>> I  found impala source   Frequent rowbatch  serialization  and deserialized.
>>   performance willbe greatly influenced  !!
>> but   in Apache drill I found that  it use columnar  format !!    I want
>> to known  what's the next plan to handle this
>>
> --
> You received this message because you are subscribed to the Google Groups
> "Impala User" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to impala-user+unsubscribe@cloudera.org.
>

Mime
View raw message