impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Juan Yu (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-5483: Automatically disable codegen for small queries
Date Fri, 23 Jun 2017 19:42:08 GMT
Juan Yu has posted comments on this change.

Change subject: IMPALA-5483: Automatically disable codegen for small queries
......................................................................


Patch Set 4:

I analyzed customer profile logs I have in hand. here are results. (note that since I don't
know if fragments are executed in parallel or not, likely I over count codegen time, so the
percentage should be even lower). 
customer   codegentime/queryduration   ratio   extra info
boa:   60/8541         < 1%
citi:  8524/47594      ~18%    all queries are less than 5s
dell:  39/10566        < 1%
rockstar:  539/20210    ~2.7%  all those queries are less than 5s
tmobile:  1770/189843  < 1%
dylan-aml: 324/29857    ~ 1%
tsel: 507/317021       < 1%

most of them are large cluster, > 100 nodes. small query percentage is usually < 1%
except citi. citi has special use case (5s SLA, all queries are short queries.

-- 
To view, visit http://gerrit.cloudera.org:8080/7153
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I273bcee58641f5b97de52c0b2caab043c914b32e
Gerrit-PatchSet: 4
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Tim Armstrong <tarmstrong@cloudera.com>
Gerrit-Reviewer: Alex Behm <alex.behm@cloudera.com>
Gerrit-Reviewer: Juan Yu <jyu@cloudera.com>
Gerrit-Reviewer: Michael Ho
Gerrit-Reviewer: Michael Ho <kwho@cloudera.com>
Gerrit-Reviewer: Tim Armstrong <tarmstrong@cloudera.com>
Gerrit-HasComments: No

Mime
View raw message