Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: neutral (athena.apache.org: 216.139.236.26 is neither permitted
 nor denied by domain of mohitanchlia@gmail.com)
Date: Thu, 3 Mar 2011 12:44:10 -0800 (PST)
From: mcasandra <mohitanchlia@gmail.com>
To: cassandra-user@incubator.apache.org
Message-ID: <1299185050415-6086307.post@n2.nabble.com>
In-Reply-To: <AANLkTimNAb9NXHOYB-j4eykiu2ZAvv+SCotrNj48PBsB@mail.gmail.com>
References: <1299005018456-6078278.post@n2.nabble.com>
 <AANLkTikOQ9ic-jZ2Xse4hNt0wUeFt-ROffij9sHitdYM@mail.gmail.com>
 <1299010248308-6078542.post@n2.nabble.com>
 <AANLkTinZmHqTKJZjfwFjow49N528LnzewuyL+C6jbmwA@mail.gmail.com>
 <1299018977921-6078983.post@n2.nabble.com>
 <AANLkTimTCDvaNXHbZDXyL9sK7S58nsB+zum7LeAT2DuN@mail.gmail.com>
 <1299088026161-6081940.post@n2.nabble.com>
 <1299181763520-6086135.post@n2.nabble.com>
 <AANLkTimNAb9NXHOYB-j4eykiu2ZAvv+SCotrNj48PBsB@mail.gmail.com>
Subject: Re: Storing photos, images, docs etc.
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit

Well it's not just metadata that I need to store but also Username, profiles,
followers etc. What I meant was store the location of the images along with
other information that I described above. And when user queries them then
pull it from the file sytem.

Most of the high volume sites (facebook, flickr, Digg etc.) currently seem
to be storing location/URI in the DB and actual blobs(images/docs) etc. on
the distributed file system. Some have written on their own and some are
using MogileFS, Lustre etc.

Can't use S3 since the requirement is to keep everything within the network
so that it's secure and under control.

Initially I thought Cassandra could be used for both row data and as well as
large files. But from what I've read and suggestions that I've got it looks
like I need to look at distributed file system which is fault taulrent and
also scales well. After reading online I can come up with only few options
like lustre, glusterfs and mogileFS to store large files. As you mentioned
lustreFS needs kernel tweaking/volume creation etc. Still trying to read
more about glusterFS. And mogileFS last updated date on the site is back in
2010 so not sure if it's still widely supported (in case of issues :)).


--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Storing-photos-images-docs-etc-tp6078278p6086307.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.