impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonghyun Hwang (Code Review)" <ger...@cloudera.org>
Subject [Impala-ASF-CR] IMPALA-3552: make incremental stats max serialized size configurable
Date Thu, 20 Oct 2016 17:21:32 GMT
Yonghyun Hwang has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/4772

Change subject: IMPALA-3552: make incremental stats max serialized size configurable
......................................................................

IMPALA-3552: make incremental stats max serialized size configurable

The fix fox "IMPALA-2648/IMPALA-2664" introduced a conservative
limitation on the maximum serialized size of incremental stats. As a
side effect, some users with very large tables are experiencing
regressions especially when upgrading.

To mitigate the issue, the change introduces a new gflag,
'inc_stat_max_size' to make the max serialized size configurable,
which allows impala users to specify their own maximum serialized
size. Default value for inc_stat_max_size is 200MB.

Change-Id: I4d189ffc1c56e7a4e27e6233e9119250a2395a19
---
M be/src/catalog/catalog.cc
M be/src/common/global-flags.cc
M be/src/service/fe-support.cc
M common/thrift/Frontend.thrift
M fe/src/main/java/org/apache/impala/analysis/ComputeStatsStmt.java
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M fe/src/main/java/org/apache/impala/common/RuntimeEnv.java
M fe/src/main/java/org/apache/impala/service/JniCatalog.java
M fe/src/test/java/org/apache/impala/testutil/CatalogServiceTestCatalog.java
10 files changed, 33 insertions(+), 13 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/4772/1
-- 
To view, visit http://gerrit.cloudera.org:8080/4772
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I4d189ffc1c56e7a4e27e6233e9119250a2395a19
Gerrit-PatchSet: 1
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Yonghyun Hwang <yonghyun@cloudera.com>

Mime
View raw message