kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Alves <davidral...@gmail.com>
Subject Re: Kudu Table Design Question
Date Thu, 27 Apr 2017 17:50:16 GMT
The suggestion of 20-30 per tablet is more about the number of available
cores than the size of the data.
Tools like impala derive parallelism from the number of tablets thus having
that count adjusted (but not necessarily equal to) to the core count gives
you a good performance tradeoff.
Of course this is not a hard limit, the tablet server should be able
anything up to 100 reasonably well depending on your hardware.


On Tue, Apr 25, 2017 at 9:19 PM, Jason Heo <jason.heo.sde@gmail.com> wrote:

> Hi.
> This email
> <http://mail-archives.apache.org/mod_mbox/kudu-user/201702.mbox/%3CCALo2W-WkicyuSiErfn2bNPyDAVd%3DjxA0hLij%2BA_tdtVBTYu-wQ%40mail.gmail.com%3E>
> many other resources) suggests that tserver should have small number of
> tablets.
> In the above mail, Dan says that:
> >> something more like 20 or 30 would be ideal depending on hardware..
> >> ...
> >> I would aim for tablet size on the order of 50GiB,
> I'm curious why 20~30 per tserver would be ideal. Does this mean storing
> 1TB~1.5TB per tserver is ideal? Could someone please explain this?
> The reason I ask is that I'm currently doing capacity planning.
> Regards,
> Jason

View raw message