impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henry Robinson (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (IMPALA-1514) DataStreamSender (and possible Coordinator) has too many sender threads
Date Tue, 20 Jun 2017 00:47:00 GMT

     [ https://issues.apache.org/jira/browse/IMPALA-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Henry Robinson resolved IMPALA-1514.
------------------------------------
       Resolution: Duplicate
    Fix Version/s: Product Backlog

Covered by IMPALA-2567

> DataStreamSender (and possible Coordinator) has too many sender threads
> -----------------------------------------------------------------------
>
>                 Key: IMPALA-1514
>                 URL: https://issues.apache.org/jira/browse/IMPALA-1514
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Distributed Exec
>    Affects Versions: Impala 2.0
>            Reporter: Alan Choi
>            Assignee: Henry Robinson
>            Priority: Minor
>              Labels: performance
>             Fix For: Product Backlog
>
>
> DataStreamSender creates one thread per EXCHANGE destination per query. On a large cluster
with a highly concurrent workload, this will create too many threads. The immediate impact
is that the thread creation time is dominating the query execution time (i.e. the prepare
time is getting very high).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message