From user-return-32377-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Mon Mar 4 19:37:50 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EC804D975 for ; Mon, 4 Mar 2013 19:37:50 +0000 (UTC) Received: (qmail 97235 invoked by uid 500); 4 Mar 2013 19:37:48 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 97201 invoked by uid 500); 4 Mar 2013 19:37:48 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 97193 invoked by uid 99); 4 Mar 2013 19:37:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Mar 2013 19:37:48 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of btv1==7750c409591==mkjellman@barracuda.com designates 64.235.145.84 as permitted sender) Received: from [64.235.145.84] (HELO bsf04.barracuda.com) (64.235.145.84) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Mar 2013 19:37:42 +0000 X-ASG-Debug-ID: 1362425840-03dc6427d6f7ed0001-f7dORa Received: from bn-scl-fe06.Cudanet.local (bn-scl-fe06.cudanet.local [10.8.1.48]) by bsf04.barracuda.com with ESMTP id 7m77OL1tuHGtvuQT (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Mon, 04 Mar 2013 11:37:20 -0800 (PST) X-Barracuda-Envelope-From: mkjellman@barracuda.com Received: from bn-scl-be03.Cudanet.local (10.8.1.54) by bn-scl-fe06.Cudanet.local (10.8.1.48) with Microsoft SMTP Server (TLS) id 8.3.279.1; Mon, 4 Mar 2013 11:37:20 -0800 Received: from bn-scl-be03.Cudanet.local ([::1]) by bn-scl-be03.Cudanet.local ([::1]) with mapi; Mon, 4 Mar 2013 11:37:19 -0800 From: Michael Kjellman X-Barracuda-Apparent-Source-IP: ::1 To: "user@cassandra.apache.org" Date: Mon, 4 Mar 2013 11:37:24 -0800 Subject: Re: Storage question Thread-Topic: Storage question X-ASG-Orig-Subj: Re: Storage question Thread-Index: Ac4ZD68F7D8f3Uo8RgqPsj/5uhM65g== Message-ID: In-Reply-To: <57C7C3CBDCB04F45A57AEC4CB21C0CCD1DB5EDE5@mbx024-e1-nj-6.exch024.domain.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.1.130117 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CD5A379813DDBmkjellmanbarracudacom_" MIME-Version: 1.0 X-Barracuda-Connect: bn-scl-fe06.cudanet.local[10.8.1.48] X-Barracuda-Start-Time: 1362425840 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://bsf04.barracuda.com:8000/cgi-mod/mark.cgi Received-SPF: softfail (barracuda.com: domain of transitioning mkjellman@barracuda.com does not designate ::1 as permitted sender) X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at barracuda.com X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests=BSF_SPF_SOFTFAIL, HTML_MESSAGE, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.124253 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 HTML_MESSAGE BODY: HTML included in message 0.00 BSF_SPF_SOFTFAIL Custom Rule SPF Softfail X-Virus-Checked: Checked by ClamAV on apache.org --_000_CD5A379813DDBmkjellmanbarracudacom_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable The best way would be to chunk your binary blobs into 1/2MB chunks. You could store Key (md5 of entire blob) =3D> part1, part2, part3 etc BytesType Validation Then if you want the entire image just grab the key (md5)..obviously you'll= need a index somewhere with a filename =3D> md5 Best, Michael From: Kanwar Sangha > Reply-To: "user@cassandra.apache.org" > Date: Monday, March 4, 2013 11:34 AM To: "user@cassandra.apache.org" > Subject: Storage question Hi =96 Can someone suggest the optimal way to store files / images ? We are= planning to use cassandra for meta-data for these files. HDFS is not good= for small file size .. can we look at something else ? Thanks, Kanwar Copy, by Barracuda, helps you store, protect, and share all your amazing=0D things. Start today: www.copy.com. --_000_CD5A379813DDBmkjellmanbarracudacom_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable
The best way would be to chunk = your binary blobs into 1/2MB chunks.

You could sto= re

Key (md5 of entire blob) =3D> part1, part2, = part3 etc

BytesType Validation

Then if you want the entire image just grab the key (md5)..obviously = you'll need a index somewhere with a filename =3D> md5

Best,
Michael

From: Kanwar Sangha <kanwar@mavenir.com>
Re= ply-To: "user@cas= sandra.apache.org" <user@cassandra.apache.org>
Dat= e: Monday, March 4, 2013 11:34 AM
To: "user@cass= andra.apache.org" <user@cassandra.apache.org>
Subj= ect: Storage question

Hi =96 Can someone suggest the optimal way to store files / imag= es ? We are planning to use cassandra for meta-data for these files.  = HDFS is not good for small file size .. can we

look at s= omething else ?

 

Thanks,

Kanwar

 


=0D ----------------------------------
=0D Copy, by Barracuda, helps you store, protect, and share all your amazing=0D things. Start today: www.copy= .com.=0D =0D
  ­­   --_000_CD5A379813DDBmkjellmanbarracudacom_--