incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Capriolo <edlinuxg...@gmail.com>
Subject Re: Virtual Nodes, lots of physical nodes and potentially increasing outage count?
Date Fri, 07 Dec 2012 14:08:55 GMT
Good point . hadoop sprays its blocks around randomly. Thus if replication
factor nodes are down some blocks are not found. The larger the cluster the
higher chance nodes are down.

To deal with this increase rf once the cluster gets to be very large.


On Wednesday, December 5, 2012, Eric Parusel <ericparusel@gmail.com> wrote:
> Hi all,
> I've been wondering about virtual nodes and how cluster uptime might
change as cluster size increases.
> I understand clusters will benefit from increased reliability due to
faster rebuild time, but does that hold true for large clusters?
> It seems that since (and correct me if I'm wrong here) every physical
node will likely share some small amount of data with every other node,
that as the count of physical nodes in a Cassandra cluster increases (let's
say into the triple digits) that the probability of at least one failure to
Quorum read/write occurring in a given time period would *increase*.
> Would this hold true, at least until physical nodes becomes greater than
num_tokens per node?
>
> I understand that the window of failure for affected ranges would
probably be small but we do Quorum reads of many keys, so we'd likely hit
every virtual range with our queries, even if num_tokens was 256.
> Thanks,
> Eric

Mime
View raw message