Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Message-ID: <4C17FD0A.1070201@holsman.net>
Date: Tue, 15 Jun 2010 18:22:02 -0400
From: Ian Holsman <lists@holsman.net>
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US;
 rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4
MIME-Version: 1.0
To: common-user@hadoop.apache.org, user@cassandra.apache.org
Subject: [OT] Real Time Open source solutions for aggregation and stream
 processing
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

firstly, my apologies for the off-topic message,
but I thought most people on this list would be knowledgeable and 
interested in this kind of thing.

We are looking to find a open source, scalable solution to do RT 
aggregation and stream processing (similar to what the 'hop' project 
http://code.google.com/p/hop/ set out to do) for large(ish) click-stream 
logs.

My first thought was something like esper, but in our testing it kind of 
hits the wall at around 10,000 rules per JVM.

I was wondering if any of you guys had some experiences in this area, 
and what your favorite toolsets are around this.

currently we are using cassandra and redis with home grown software to 
do the aggregation, but I'd love to use a common package if there is one.

and again.. apologies for the off-topic message and the x-posting.

regards
Ian