Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of tivv00@gmail.com designates
 209.85.160.44 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEKtLiQuedN94t6XXvpiwfjnA81GazOm7nBkmiFW1KuVS1H3pw@mail.gmail.com>
References: 
 <CAEKtLiQQd1Fqchwseqjd=FhYYiiOeGQ2tCKC85JWpjeECS98KA@mail.gmail.com>
	<95A58592-F2C5-4BE2-BCCE-F852AF27A228@thelastpickle.com>
	<CAEKtLiQFcumvtpr0N5uZtpjOV9ZvSLWEk2E49E_Yxx9wPonLow@mail.gmail.com>
	<0901B9F6-D723-4ADD-9B24-75FB1D630940@thelastpickle.com>
	<CAEKtLiQuedN94t6XXvpiwfjnA81GazOm7nBkmiFW1KuVS1H3pw@mail.gmail.com>
Date: Wed, 19 Sep 2012 06:42:41 +0300
Message-ID: 
 <CABWW-d0dyf38qAu+i7nAzcpb8v-qXGSGtXLmbL=4zrhRs2i_cQ@mail.gmail.com>
Subject: Re: Disk configuration in new cluster node
From: =?KOI8-U?B?96bUwcymyiD0yc3eydvJzg==?= <tivv00@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=e89a8ff242db7fed6204ca05cc0d

--e89a8ff242db7fed6204ca05cc0d
Content-Type: text/plain; charset=ISO-8859-1

Network also matters. It would take a lot of time sending 6TB over 1Gb
link, even fully saturating it. IMHO You can try with 10Gb, but you will
need to raise your streaming/compaction limits a lot.
Also you will need to ensure that your compaction can keep up. It is often
done in one thread and I am not sure if it will be enough for you. As of
parallel compaction, I don't know exact limitations and if it will be
working in your case.

2012/9/18 Casey Deccio <casey@deccio.net>

> On Tue, Sep 18, 2012 at 1:54 AM, aaron morton <aaron@thelastpickle.com>wrote:
>
>> each with several disks having large capacity, totaling 10 - 12 TB.  Is
>> this (another) bad idea?
>>
>> Yes. Very bad.
>> If you had 6TB on average system with spinning disks you would measure
>> duration of repairs and compactions in days.
>>
>> If you want to store 12 TB of data you will need more machines.
>>
>>
>
> Would it help if I partitioned the computing resources of my physical
> machines into VMs?  For example, I put four VMs on each of three virtual
> machines, each with a dedicated 2TB drive.  I can now have four tokens in
> the ring and a RF of 3.  And of course, I can arrange them into a way that
> makes the most sense.  Is this getting any better, or am I missing the
> point?
>
> Casey
>


-- 
Best regards,
 Vitalii Tymchyshyn

--e89a8ff242db7fed6204ca05cc0d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Network also matters. It would take a lot of time sending 6TB over 1Gb link=
, even fully saturating it. IMHO You can try with 10Gb, but you will need t=
o raise your streaming/compaction limits a lot.<div>Also you will need to e=
nsure that your compaction can keep up. It is often done in one thread and =
I am not sure if it will be enough for you. As of parallel compaction, I do=
n&#39;t know exact limitations and if it will be working in your case.<br>
<br><div class=3D"gmail_quote">2012/9/18 Casey Deccio <span dir=3D"ltr">&lt=
;<a href=3D"mailto:casey@deccio.net" target=3D"_blank">casey@deccio.net</a>=
&gt;</span><br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex=
;border-left:1px #ccc solid;padding-left:1ex">
<div class=3D"im">On Tue, Sep 18, 2012 at 1:54 AM, aaron morton <span dir=
=3D"ltr">&lt;<a href=3D"mailto:aaron@thelastpickle.com" target=3D"_blank">a=
aron@thelastpickle.com</a>&gt;</span> wrote:<br></div><div class=3D"gmail_q=
uote"><div class=3D"im">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
<div style=3D"word-wrap:break-word"><div><blockquote type=3D"cite"><div cla=
ss=3D"gmail_quote">each with several disks having large capacity, totaling =
10 - 12 TB. =A0Is this (another) bad idea?</div></blockquote></div><div>
Yes. Very bad.=A0<div>If you had 6TB on average system with spinning disks =
you would measure duration of repairs and compactions in days.=A0</div><div=
><br></div><div>If you want to store 12 TB of data you will need more machi=
nes.=A0</div>

<div>=A0</div></div></div></blockquote><div><br></div></div><div>Would it h=
elp if I partitioned the computing resources of my physical machines into V=
Ms? =A0For example, I put four VMs on each of three virtual machines, each =
with a dedicated 2TB drive. =A0I can now have four tokens in the ring and a=
 RF of 3. =A0And of course, I can arrange them into a way that makes the mo=
st sense. =A0Is this getting any better, or am I missing the point?</div>
<span class=3D"HOEnZb"><font color=3D"#888888">
<div><br></div><div>Casey</div></font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Best regards=
,<br>=A0Vitalii Tymchyshyn<br>
</div>

--e89a8ff242db7fed6204ca05cc0d--