kudu-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From granthe...@apache.org
Subject [kudu] 03/04: [docs] Add maximum tablet size recommendations
Date Fri, 12 Apr 2019 21:51:12 GMT
This is an automated email from the ASF dual-hosted git repository.

granthenke pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kudu.git

commit db71eeb25d70253d968da27bcae92fcf2a067abe
Author: Grant Henke <granthenke@apache.org>
AuthorDate: Tue Apr 9 17:43:34 2019 -0700

    [docs] Add maximum tablet size recommendations
    Based primarily on the collective experience of many of
    the Kudu committers, this patch attempts to provide
    some guardrail limits and recomendations on tablet
    size. It doesn’t enumurate all of the issues that occur
    with very large tablets, primarily because they are
    not all known, but gives some examples of issues
    that have been seen as tablets go over the proposed
    limit of 50 GiB.
    I also updated existing usage of GB/TB to GiB/TiB.
    Change-Id: I9fe48e483334812795d124ee63a3af92f39135de
    Reviewed-on: http://gerrit.cloudera.org:8080/12979
    Tested-by: Grant Henke <granthenke@apache.org>
    Reviewed-by: Mike Percy <mpercy@apache.org>
    Reviewed-by: Adar Dembo <adar@cloudera.com>
 docs/known_issues.adoc | 10 +++++++---
 1 file changed, 7 insertions(+), 3 deletions(-)

diff --git a/docs/known_issues.adoc b/docs/known_issues.adoc
index 8425d00..bfd8709 100644
--- a/docs/known_issues.adoc
+++ b/docs/known_issues.adoc
@@ -114,8 +114,8 @@
 == Server management
-* Production deployments should configure a least 4GB of memory for tablet servers,
-  and ideally more than 16GB when approaching the data and tablet <<Scale>> limits.
+* Production deployments should configure a least 4 GiB of memory for tablet servers,
+  and ideally more than 16 GiB when approaching the data and tablet <<Scale>>
 * Write ahead logs (WAL) can only be stored on one disk.
@@ -136,7 +136,7 @@
 * Recommended maximum number of masters is 3.
 * Recommended maximum amount of stored data, post-replication and post-compression,
-  per tablet server is 8TB.
+  per tablet server is 8 TiB.
 * The maximum number of tablets per tablet server is 2000, post-replication,
   but we recommend 1000 tablets or fewer per tablet server.
@@ -144,6 +144,10 @@
 * Maximum number of tablets per table for each tablet server is 60,
   post-replication (assuming the default replication factor of 3), at table-creation time.
+* Recommended maximum amount of data per tablet is 50 GiB. Going beyond this can cause
+  issues such a reduced performance, compaction issues, and slow tablet startup times.
+  The recommended target size for tablets is under 10 GiB.
 == Replication and Backup Limitations
 * Kudu does not currently include any built-in features for backup and restore.

View raw message