impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (Code Review)" <>
Subject [Impala-CR](cdh5-trunk) IMPALA-3670: fix sorter buffer mgmt bugs
Date Tue, 07 Jun 2016 05:06:03 GMT
Tim Armstrong has submitted this change and it was merged.

Change subject: IMPALA-3670: fix sorter buffer mgmt bugs

IMPALA-3670: fix sorter buffer mgmt bugs

Also make more deterministic, by using
max_block_mgr_memory, which doesn't include scanner memory.
The fixed exercises the other sorter bugs
that occurs when scratch cannot be written.

Added a test that does a sort with various memory limits and consumes
the whole output of the sorter (we have many tests of sorts with limits
but limited coverage of sorts without limits).  Ran an exhaustive test
run before posting for review.

This added test reproduced one of the sorter bugs, where var-len blocks
were not always attached to the output batch. The other test was
reproduced by the test change in IMPALA-3669: test_scratch_disk fix.

Change-Id: Ia1a0ddffa0a5b157ab86a376b7b7360a923698d6
Reviewed-by: Tim Armstrong <>
Tested-by: Tim Armstrong <>
M be/src/runtime/
M tests/query_test/
2 files changed, 45 insertions(+), 25 deletions(-)

  Tim Armstrong: Looks good to me, approved; Verified

To view, visit
To unsubscribe, visit

Gerrit-MessageType: merged
Gerrit-Change-Id: Ia1a0ddffa0a5b157ab86a376b7b7360a923698d6
Gerrit-PatchSet: 7
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Matthew Jacobs <>
Gerrit-Reviewer: Tim Armstrong <>

View raw message