Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 397CADE78 for ; Tue, 16 Oct 2012 15:54:41 +0000 (UTC) Received: (qmail 64539 invoked by uid 500); 16 Oct 2012 15:54:38 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 64511 invoked by uid 500); 16 Oct 2012 15:54:38 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 64501 invoked by uid 99); 16 Oct 2012 15:54:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Oct 2012 15:54:38 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [192.174.58.134] (HELO XEDGEA.nrel.gov) (192.174.58.134) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Oct 2012 15:54:31 +0000 Received: from XHUBA.nrel.gov (10.20.4.58) by XEDGEA.nrel.gov (192.174.58.134) with Microsoft SMTP Server (TLS) id 8.3.245.1; Tue, 16 Oct 2012 09:53:59 -0600 Received: from MAILBOX2.nrel.gov ([fe80::19a0:6c19:6421:12f]) by XHUBA.nrel.gov ([::1]) with mapi; Tue, 16 Oct 2012 09:54:09 -0600 From: "Hiller, Dean" To: "user@cassandra.apache.org" Date: Tue, 16 Oct 2012 09:54:15 -0600 Subject: Re: Using Cassandra to store binary files? Thread-Topic: Using Cassandra to store binary files? Thread-Index: Ac2rtno0c7DCkbSsTyaKGTlVWeJCdg== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.3.120616 acceptlanguage: en-US Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Astyanax provides a streaming file feature and was written by netflix who i= s storing probably a huge amount of files with that feature. I was going t= o use that feature for one product but I never got around to creating the p= roduct=85..but I still use astyanax under the hood of PlayOrm (we kind of = use a combination so we can put some relational data in cassandra with Play= Orm and then do our own thing as well with noSQL with the raw astyanx apis = as well)=85..it gets rid of us needing the RDBMS at all which is nice. Later, Dean From: Vasileios Vlachos > Reply-To: "user@cassandra.apache.org" > Date: Tuesday, October 16, 2012 9:49 AM To: "user@cassandra.apache.org" > Subject: Using Cassandra to store binary files? ed to store about 40G of binary files in a redundant way and since we are a= lready using Cassandra for other applications we were thinking that we coul= d just solve that problem using the same Cassandra cluster. Each individual= File will be approximately 1MB. We are thinking that the data structure should be very simple for this case= , using one CF with just one column which will contain the actual files. Th= e row key should then uniquely identify each file. Speed is not an issue wh= en we retrieving the files. Impacting other applications using Cassandra is= more important for us. In order to prevent performance issues with other a= pplications using our Cassandra cluster at the moment, we think we should d= isable key_cache and row_cache for this column family. Anyone tried this before or anyone thinks this is going to be a bad idea? D= o you think our current plan is sensible? Any input would be much appreciat= ed. Thank you in adv