impala-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Behm (Code Review)" <>
Subject [Impala-ASF-CR] [DOCS] Tighten up advice about first COMPUTE INCREMENTAL STATS
Date Fri, 06 Oct 2017 21:53:46 GMT
Alex Behm has posted comments on this change. ( )

Change subject: [DOCS] Tighten up advice about first COMPUTE INCREMENTAL STATS

Patch Set 4:

File docs/shared/impala_common.xml:
PS4, Line 1227:         <codeph>COMPUTE INCREMENTAL STATS</codeph> during the
lifetime of a table,
(or vice versa)
PS4, Line 1243:         be cached on every <cmdname>impalad</cmdname> host that
is eligible to be a coordinator.
as it must be cached on the catalogd and on every ...
PS4, Line 1244:         If this metadata for a table exceeds 2 GB, you might experience service
It's worse than that. If the aggregate metadata of *all* tables combined gets to 2GB you may
experience downtime.
File docs/topics/impala_partitioning.xml:
PS4, Line 612:         as new partitions are added, Impala includes a variation of this statement
that is intended for use with
How about:

includes a variation of this statement that allows computing statistics on a per-partition
basis such that stats can be incrementally updated when new partitions are added.
File docs/topics/impala_perf_stats.xml:
PS4, Line 361:           <codeph>COMPUTE STATS</codeph> statement might take hours,
or even days. For such tables, use
Sorry, I disagree with the "For such tables, use COMPUTE INCREMENTAL STATS" part. I think
we need to be very careful about recommending incremental stats. We can document what it does,
but I think we should go out of out way to not explicitly recommend it for any reason.

To view, visit
To unsubscribe, visit

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ia53a6518ce5541e5c9a2cd896856ce042a599b03
Gerrit-Change-Number: 7999
Gerrit-PatchSet: 4
Gerrit-Owner: John Russell <>
Gerrit-Reviewer: Alex Behm <>
Gerrit-Reviewer: Greg Rahn <>
Gerrit-Reviewer: John Russell <>
Gerrit-Reviewer: Mostafa Mokhtar <>
Gerrit-Reviewer: Silvius Rus <>
Gerrit-Reviewer: Vuk Ercegovac <>
Gerrit-Comment-Date: Fri, 06 Oct 2017 21:53:46 +0000
Gerrit-HasComments: Yes

  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message