Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CF66D105AC for ; Mon, 7 Apr 2014 11:25:03 +0000 (UTC) Received: (qmail 5246 invoked by uid 500); 7 Apr 2014 11:25:00 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 4627 invoked by uid 500); 7 Apr 2014 11:25:00 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 4613 invoked by uid 99); 7 Apr 2014 11:24:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 11:24:58 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS,T_FILL_THIS_FORM_SHORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of prvs=1676d0581=hari.rajendhran@tcs.com designates 122.184.60.14 as permitted sender) Received: from [122.184.60.14] (HELO inchng02.tcs.com) (122.184.60.14) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 11:24:55 +0000 X-IronPort-AV: E=Sophos;i="4.97,809,1389724200"; d="scan'208,217";a="63775035" X-DISCLAIMER: FALSE Received: from INCHNSIRDLP01 (unknown [127.0.0.1]) by INCHNSIRDLP01.localdomain (Service) with ESMTP id 5AAAA1F413 for ; Mon, 7 Apr 2014 16:54:31 +0530 (IST) Received: from InChnM11.tcs.com (unknown [172.16.221.193]) by INCHNSIRDLP01.localdomain (Service) with ESMTP id 302701F402 for ; Mon, 7 Apr 2014 16:54:31 +0530 (IST) X-Disclaimed: 1 MIME-Version: 1.0 Importance: Normal X-Priority: 3 (Normal) In-Reply-To: <534287B1.50008@enercast.de> References: <534287B1.50008@enercast.de>, Subject: Re: Cassandra Disk storage capacity From: Hari Rajendhran To: user@cassandra.apache.org Message-ID: Date: Mon, 7 Apr 2014 16:54:29 +0530 X-Mailer: Lotus Domino Web Server Release 8.5.2FP4HF188 September 13, 2012 X-MIMETrack: Serialize by Notes Server on InChnM11/TCS(Release 8.5.2FP4HF188 | September 13, 2012) at 04/07/2014 16:54:29, Serialize complete at 04/07/2014 16:54:29, Itemize by Notes Server on InChnM11/TCS(Release 8.5.2FP4HF188 | September 13, 2012) at 04/07/2014 16:54:29, Serialize by Router on InChnM11/TCS(Release 8.5.2FP4HF188 | September 13, 2012) at 04/07/2014 16:54:30, Serialize complete at 04/07/2014 16:54:30 Content-Type: multipart/alternative; boundary="=_alternative 003EAABC65257CB3_=" X-Virus-Checked: Checked by ClamAV on apache.org --=_alternative 003EAABC65257CB3_= Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1 Hi, Thanks for the update=A0 Still i have few queries which needs to be clarified=A0 1) I am confused why cassandra uses the entire disk space ( / Directory) ev= en when we specify /var/lib/cassandra/data as the directory in Cassandra.ya= ml file 2) Is it only during compaction ,cassandra will use the entire Disk space ? 3) What is the best way to monitor the cassandra Disk usage ?? is there a o= pensource monitoring tool for this ?? Best Regards Hari Krishnan Rajendhran Hadoop Admin DESS-ABIM ,Chennai BIGDATA Galaxy Tata Consultancy Services Cell:- 9677985515 Mailto: hari.rajendhran@tcs.com Website: http://www.tcs.com =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F Experience certainty. IT Services Business Solutions Consulting =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F -----Jan Kesten wrote: ----- To: user@cassandra.apache.org From: Jan Kesten Date: 04/07/2014 04:41PM Subject: Re: Cassandra Disk storage capacity Hi Hari, C* will use your entire space - that is something one should monitor. Depen= ding on your choose on compaction strategy your data=5Fdir should not be fi= lled up entirely - in the worst case compaction will need space as large as= the sstables on disk, therefore 50% should be free space. The parameters used for on disk storage are commitlog=5Fdirectory and data= =5Ffile=5Fdirectories and saved=5Fcaches=5Fdirectory. The paramter data=5Ff= ile=5Fdirectories is in plural, you can easily put more than one directory = here (and you should do this instead of using RAID).=20 Cheers, Jan Am 07.04.2014 12:56, schrieb Hari Rajendhran: Hi Team, We have a 3 node Apache cassandra 2.0.4 setup installed in our lab setup.We= have set data directory to /var/lib/cassandra/data.What would be the maxim= um=A0 disk storage that will be used for cassandra data storage. Note : /var partition has a storage capacity of 40GB. My question is whether cassandra will =A0the entire / directory for data st= orage ? If no, how to specify multiple directories for data storage ?? =A0 =A0 Best Regards Hari Krishnan Rajendhran Hadoop Admin DESS-ABIM ,Chennai BIGDATA Galaxy Tata Consultancy Services Cell:- 9677985515 Mailto: hari.rajendhran@tcs.com Website: http://www.tcs.com =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F Experience certainty. IT Services Business Solutions Consulting =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F =3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D Notice: The information contained in this e-mail message and/or attachments to it may contain=20 confidential or privileged information. If you are=20 not the intended recipient, any dissemination, use,=20 review, distribution, printing or copying of the=20 information contained in this e-mail message=20 and/or attachments to it are strictly prohibited. If=20 you have received this communication in error,=20 please notify us by reply e-mail or telephone and=20 immediately and permanently delete the message=20 and any attachments. Thank you --=20 Jan Kesten, mailto:j.kesten@enercast.de Tel.: +49 561/4739664-0 FAX: -9 enercast GmbH Friedrich-Ebert-Str. 104 D-34119 Kassel =A0 =A0 =A0 HRB15471 http://www.enercast.de=A0Online-Prognosen f=FCr erneuerbare Energien Gesch=E4ftsf=FChrung: Dipl. Ing. Thomas Landgraf, Bernd Kratz Diese E-Mail und etwaige Anh=E4nge k=F6nnen vertrauliche und/oder rechtlich= gesch=FCtzte Informationen enthalten. Falls Sie nicht der angegebene Empf= =E4nger sind oder falls diese E-Mail irrt=FCmlich an Sie adressiert wurde, = benachrichtigen Sie uns bitte sofort durch Antwort-E-Mail und l=F6schen Sie= diese E-Mail nebst etwaigen Anlagen von Ihrem System. Ebenso d=FCrfen Sie = diese E-Mail oder ihre Anlagen nicht kopieren oder an Dritte weitergeben. V= ielen Dank. This e-mail and any attachment may contain confidential and/or privileged i= nformation. If you are not the named addressee or if this transmission has = been addressed to you in error, please notify us immediately by reply e-mai= l and then delete this e-mail and any attachment from your system. Please u= nderstand that you must not copy this e-mail or any attachment or disclose = the contents to any other person. Thank you for your cooperation. --=_alternative 003EAABC65257CB3_= Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1 Hi,

Thanks for the update 

Still i have few queries which needs to be clarified 

1) I am confused why cassandra uses the entire disk space = ( / Directory) even when we specify /var/lib/cassandra/data as the director= y in Cassandra.yaml file
2) Is it only during compaction ,cassand= ra will use the entire Disk space ?
3) What is the best way to mo= nitor the cassandra Disk usage ?? is there a opensource monitoring tool for= this ??



Best Regards
Hari Krishnan RajendhranHadoop Admin
DESS-ABIM ,Chennai BIGDATA Galaxy
Tata Consultancy Serv= ices
Cell:- 9677985515
Mailto: hari.rajendhran@tcs.com
Website: ht= tp://www.tcs.com
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F
Experience certainty. IT Services
Business Solutions
Con= sulting
=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F

-----Jan Kesten <j.kesten@enercast.de&g= t; wrote: -----
To: u= ser@cassandra.apache.org
From: Jan Kesten <j.kesten@enercast.de>Date: 04/07/2014 04:41PM
Subject: Re: Cassandra Disk storage capacity<= br>
=0D =0D =0D =0D =0D
Hi Hari,
=0D
=0D C* will use your en= tire space - that is something one should=0D monitor. Depending on you= r choose on compaction strategy your=0D data=5Fdir should not be fille= d up entirely - in the worst case=0D compaction will need space as lar= ge as the sstables on disk,=0D therefore 50% should be free space.
= =0D
=0D The parameters used for on disk storage are commitlog= =5Fdirectory=0D and data=5Ffile=5Fdirectories and saved=5Fcaches=5Fdir= ectory. The paramter=0D data=5Ffile=5Fdirectories is in plural, you ca= n easily put more than=0D one directory here (and you should do this i= nstead of using RAID).=0D
=0D
=0D Cheers,
=0D = Jan
=0D
=0D Am 07.04.2014 12:56, schrieb Hari Rajendhran= :
=0D
=0D
Hi= =0D Team,=0D

=0D =0D
We have a 3 node Apache cassandra 2.0.4 setup=0D = installed in our lab setup.We have set data directory to=0D = /var/lib/cassandra/data.What would be the maximum 
= =0D
disk storage that will be used for cassandra data=0D = storage.
=0D

=0D
=0D
Note : /var partition has a storage capacity= of 40GB.
=0D

=0D
= =0D
My question is whether cassandra will  the entir= e /=0D directory for data storage ?
=0D
= If no, how to specify multiple directories for data=0D sto= rage ??
=0D

=0D
=0D=
 
=0D
=0D
=0D =  
=0D Best Regards
=0D Hari Krishna= n Rajendhran
=0D Hadoop Admin
=0D DESS-ABIM ,Ch= ennai BIGDATA Galaxy
=0D Tata Consultancy Services
=0D = Cell:- 9677985515
=0D Mailto: hari.rajendhran@tcs.= com
=0D Website: http://www.tcs.com
=0D =5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F
=0D Experien= ce certainty. IT Services
=0D Business Solutions
=0D = Consulting
=0D =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F=5F= =5F=5F=5F=5F=5F=5F
=0D =0D

=3D=3D=3D=3D=3D-= ----=3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D
=0D Notice: The informati= on contained in this e-mail
=0D message and/or attachments to it = may contain
=0D confidential or privileged information. If you a= re
=0D not the intended recipient, any dissemination, use,
= =0D review, distribution, printing or copying of the
=0D = information contained in this e-mail message
=0D and/or attachme= nts to it are strictly prohibited. If
=0D you have received this= communication in error,
=0D please notify us by reply e-mail or= telephone and
=0D immediately and permanently delete the messag= e
=0D and any attachments. Thank you

=0D
=0D =
=0D
=0D --
Jan Kesten, mailto:j.kesten@enercast.de
Tel.: +49 561/473= 9664-0 FAX: -9
enercast GmbH Friedrich-Ebert-Str. 104 D-34119 Kassel &nb= sp;     HRB15471
http://www.enercast.de Online-Prognosen f=FC= r erneuerbare Energien
Gesch=E4ftsf=FChrung: Dipl. Ing. Thomas Landgraf,= Bernd Kratz

Diese E-Mail und etwaige Anh=E4nge k=F6nnen vertraulich= e und/oder rechtlich gesch=FCtzte Informationen enthalten. Falls Sie nicht = der angegebene Empf=E4nger sind oder falls diese E-Mail irrt=FCmlich an Sie= adressiert wurde, benachrichtigen Sie uns bitte sofort durch Antwort-E-Mai= l und l=F6schen Sie diese E-Mail nebst etwaigen Anlagen von Ihrem System. E= benso d=FCrfen Sie diese E-Mail oder ihre Anlagen nicht kopieren oder an Dr= itte weitergeben. Vielen Dank.

This e-mail and any attachment may co= ntain confidential and/or privileged information. If you are not the named = addressee or if this transmission has been addressed to you in error, pleas= e notify us immediately by reply e-mail and then delete this e-mail and any= attachment from your system. Please understand that you must not copy this= e-mail or any attachment or disclose the contents to any other person. Tha= nk you for your cooperation.
=0D =0D=0D
<= /div> --=_alternative 003EAABC65257CB3_=--