impala-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dan Hecht (Code Review)" <>
Subject [Impala-CR](cdh5-trunk) IMPALA-2399: Check for mem limit in allocations in parquet scanner and decompressor.
Date Thu, 03 Mar 2016 04:07:16 GMT
Dan Hecht has posted comments on this change.

Change subject: IMPALA-2399: Check for mem limit in allocations in parquet scanner and decompressor.

Patch Set 7:

File be/src/common/

Line 20: #include "runtime/runtime-state.h"
it seems a bit unfortunate to add the dependency in this direction since status is such a
low-level primitive. What do you think about instead making the new method a member of MemTracker
or RuntimeState?
File be/src/exec/

Line 755:           len, "StringValue");
nit: get rid of 'details' variables, but okay to ignore if you prefer it this way.

Line 757:           parent_->state_, details, (int64_t)len);
i agree its better to not introduce more SetMemLimitExceeded() calls since we want to get
rid of that as part of this work.
File be/src/runtime/

Line 244: void RuntimeState::LogFailedAllocDetails(const MemTracker* tracker,
"Log" could mean LOG/VLOG rather than LogError() and failed allocations are not exactly the
same as mem limit exceeded (they could happen for other reasons), so how about calling this
thing: LogErrorMemLimitExceeded()?

Line 268:   }
not for this change, but I wonder if the stuff we pass to LogError() should instead become
detail to the MemLimitExceeded status itself.

Line 273:   DCHECK_GE(failed_allocation_size, 0);
this DCHECK could be in the Log function.

To view, visit
To unsubscribe, visit

Gerrit-MessageType: comment
Gerrit-Change-Id: Ic70400407b7662999332448f4d1bce2cc344ca89
Gerrit-PatchSet: 7
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Michael Ho <>
Gerrit-Reviewer: Dan Hecht <>
Gerrit-Reviewer: Michael Ho <>
Gerrit-Reviewer: Skye Wanderman-Milne <>
Gerrit-Reviewer: Tim Armstrong <>
Gerrit-HasComments: Yes

View raw message