Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of jeremy.hanna1234@gmail.com
 designates 209.85.161.172 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=content-type:mime-version:subject:from:in-reply-to:date
         :content-transfer-encoding:message-id:references:to:x-mailer;
        b=fqt9vuTdPLH1t90jo73QGA4wFkdY+yeDVOEICaLvaF3MgcpejOaY0Thvizc0TzXvwq
         Ohyx0AqLd+oG4g3jGYF0LKAEf+rIGi1suIew9hK/8AfGA5eD+EwyfEt/Ui7ElQGswkZO
         WVfROhgxfwChmrLk5iTZNtnkghmidwLj0D7ZA=
Content-Type: text/plain; charset=windows-1252
Mime-Version: 1.0 (Apple Message framework v1081)
Subject: Re: Cassandra vs MongoDB
From: Jeremy Hanna <jeremy.hanna1234@gmail.com>
In-Reply-To: <3b4537b4-07bc-e29a-b5c2-a4059067d691@me.com>
Date: Wed, 28 Jul 2010 16:59:22 -0500
Content-Transfer-Encoding: quoted-printable
Message-Id: <A2E2F9CF-31E1-4BF9-91F3-FA0EB0BDC91D@gmail.com>
References: <3b4537b4-07bc-e29a-b5c2-a4059067d691@me.com>
To: user@cassandra.apache.org

> "As a result, we designed and built Flume...
> (I wonder if this could deliver into Cassanda :) )


Yes - apparently it's pretty easy to do - I was thinking of doing it but =
haven't found the time yet.

https://issues.cloudera.org//browse/FLUME-20

On Jul 28, 2010, at 4:30 PM, Aaron Morton wrote:

>=20
>> If you are looking to store web logs and then do ad hoc queries you =
might/should be using Hadoop (depending on how big your logs are)
> =20
> I agree, take a look at the Cloudera Hadopp 3 CDH3, they include an =
app called Flume for moving data...
>=20
> "As a result, we designed and built Flume. Flume is a distributed =
service that makes it very easy to collect and aggregate your data into =
a persistent store such as HDFS. Flume can read data from almost any =
source =96 log files, Syslog packets, the standard output of any Unix =
process =96 and can deliver it to a batch processing system like Hadoop =
or a real-time data store like HBase. All this can be configured =
dynamically from a single, central location =96 no more tedious =
configuration file editing and process restarting. Flume will collect =
the data from wherever existing applications are storing it, and whisk =
it away for further analysis and processing."
>=20
> (I wonder if this could deliver into Cassanda :) )
>=20
> If it's straight log file processing Hadoop may be a better fit.
>=20
> Aaron