cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jon Haddad (JIRA)" <>
Subject [jira] [Comment Edited] (CASSANDRA-8494) incremental bootstrap
Date Thu, 02 Mar 2017 02:43:45 GMT


Jon Haddad edited comment on CASSANDRA-8494 at 3/2/17 2:42 AM:

It looks like the original thing won't be done because of the insanity due to shuffle.  Was
anything actually done related this this ticket?  I guess it can be closed.  Any objections?

was (Author: rustyrazorblade):
It looks like the original thing won't be done because of the insanity due to shuffle - so
I'm renaming this & marking as done.

> incremental bootstrap
> ---------------------
>                 Key: CASSANDRA-8494
>                 URL:
>             Project: Cassandra
>          Issue Type: New Feature
>            Reporter: Jon Haddad
>            Assignee: Yuki Morishita
>            Priority: Minor
>              Labels: dense-storage
>             Fix For: 3.11.x
> Current bootstrapping involves (to my knowledge) picking tokens and streaming data before
the node is available for requests.  This can be problematic with "fat nodes", since it may
require 20TB of data to be streamed over before the machine can be useful.  This can result
in a massive window of time before the machine can do anything useful.
> As a potential approach to mitigate the huge window of time before a node is available,
I suggest modifying the bootstrap process to only acquire a single initial token before being
marked UP.  This would likely be a configuration parameter "incremental_bootstrap" or something
> After the node is bootstrapped with this one token, it could go into UP state, and could
then acquire additional tokens (one or a handful at a time), which would be streamed over
while the node is active and serving requests.  The benefit here is that with the default
256 tokens a node could become an active part of the cluster with less than 1% of it's final
data streamed over.

This message was sent by Atlassian JIRA

View raw message