impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Silvius Rus <s...@cloudera.com>
Subject Re: impala process create too many thread (in our cluster 200 service sometimes over 15000+)
Date Sat, 26 Mar 2016 21:13:35 GMT
+dev@impala.incubator.apache.org, Henry, Marcel
bcc:impala-dev@cloudera.org

I believe this is documented as
https://issues.cloudera.org/browse/IMPALA-1514.

Henry, Marcel, do you know if this will be worked on as part of upcoming
scalability improvements?

On Fri, Mar 25, 2016 at 8:54 PM, zhen <yyzzjj0515@gmail.com> wrote:

>
> Recently debug impala performance found that the number of threads
> suddenly high and low
>
>
> About two cases
>
> 1. A complex query  will have many fragments
> 2. big cluster    example :200  impala ins
> 3. many query running
>
> just now  impala do not have thread pool
> a .ThriftServer use thread mode
> b. stream sender async channel
> will  create large volumes of  threads ,as everyone knows thread create
>  destroy is   high cost  in performance!!
>
> what is the next plan TODO
>
> --
> You received this message because you are subscribed to the Google Groups
> "Impala Dev" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to impala-dev+unsubscribe@cloudera.org.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message