kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boris Tyukin <bo...@boristyukin.com>
Subject Re: clarification on Partitioning Guidelines and CPU cores
Date Wed, 10 Oct 2018 21:39:42 GMT
Also, when they say tablets - I assume this is before replication? so in
reality, it is number of nodes x cpu cores / replication factor? If this is
the case, it is not looking good...

On Wed, Oct 10, 2018 at 5:02 PM Boris Tyukin <boris@boristyukin.com> wrote:

> Hi all,
> can someone clarify if this recommendation below - does it mean physical
> or hyper-threaded CPU cores? quite a big difference...
> Thanks,
> Boris
> Partitioning Guidelines (https://kudu.apache.org/docs/
> kudu_impala_integration.html#partitioning_rules_of_thumb)
> - For large tables, such as fact tables, aim for as many tablets as you
> have cores in the cluster.
> - For small tables, such as dimension tables, aim for a large enough
> number of tablets that each tablet is at least 1 GB in size.
> In general, be mindful the number of tablets limits the parallelism of
> reads, in the current implementation. Increasing the number of tablets
> significantly beyond the number of cores is likely to have diminishing
> returns.

View raw message