impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (Code Review)" <ger...@cloudera.org>
Subject [Impala-CR](cdh5-2.6.0 5.8.0) IMPALA-3669: test scratch disk fails on S3
Date Mon, 06 Jun 2016 21:45:20 GMT
Tim Armstrong has uploaded a new patch set (#2).

Change subject: IMPALA-3669: test_scratch_disk fails on S3
......................................................................

IMPALA-3669: test_scratch_disk fails on S3

Make the test deterministic by using max_block_mgr_memory instead of
mem_limit, so that the non-deterministic scanner memory usage does not
influence the spilling behaviour of the queries.

Testing:
Ran the test locally to confirm that it succeeded. Also manually
computed the memory requirement. The data size to be sorted is ~220MB,
so with a 64MB block manager limit per node, at least one node must
spill.

Change-Id: I9525a029ac020bb5b8bea210a741c9f9c5ec3c75
---
M tests/custom_cluster/test_scratch_disk.py
1 file changed, 8 insertions(+), 7 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/18/3318/2
-- 
To view, visit http://gerrit.cloudera.org:8080/3318
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I9525a029ac020bb5b8bea210a741c9f9c5ec3c75
Gerrit-PatchSet: 2
Gerrit-Project: Impala
Gerrit-Branch: cdh5-2.6.0_5.8.0
Gerrit-Owner: Tim Armstrong <tarmstrong@cloudera.com>

Mime
View raw message