impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Casey Ching (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-trunk) Misc query generator improvements
Date Fri, 04 Mar 2016 01:24:09 GMT
Casey Ching has uploaded a new patch set (#2).

Change subject: Misc query generator improvements
......................................................................

Misc query generator improvements

Changes:

1) Improve generation of boolean expressions to be more realistic.
   Previously functions like And and Or were very unlikely to be chosen
   because they only use Booleans and the generator prefers functions
   that use Ints. This is especially bad now that ON expressions may be
   arbitrary (previously they were hard coded to use Ands and Equals).
   Now And/Or are special cased when generating a Boolean expressions so
   they'll be more likely to be used.
2) Randomly choose query options. This is very basic. With this change
   Impala gets OOM killed because there are 3 nodes running locally and
   each of them is configured to use 80% of the total memory. Another
   update will be needed to start the mini-cluster with less memory.
3) Fix bug where a generated function tree would not be a tree at all,
   it would just be one function.

Change-Id: I75a7e6a1d96e5d92368f73c1e5e6a6b288932497
---
M tests/comparison/discrepancy_searcher.py
M tests/comparison/query_generator.py
M tests/comparison/query_profile.py
3 files changed, 460 insertions(+), 109 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/45/2445/2
-- 
To view, visit http://gerrit.cloudera.org:8080/2445
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I75a7e6a1d96e5d92368f73c1e5e6a6b288932497
Gerrit-PatchSet: 2
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Casey Ching <casey@cloudera.com>

Mime
View raw message