incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Real-time processing with Hama
Date Thu, 13 Oct 2011 12:41:50 GMT
+1 Looks good to me.

Let's update examples wiki pages first.

On Thu, Oct 13, 2011 at 8:50 PM, Thomas Jungblut
<thomas.jungblut@googlemail.com> wrote:
> You may already read it on twitter, I made a little BSP for this:
>
> https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/bsp/DataStreamProcessing.java
>
> Maybe we can integrate this as an example? I would replace the while(true)
> loop with a finite amount of tweets to process. And if a user does not give
> an account, use a global timeline.
> Anything we should add for real time processing?
>
> 2011/10/13 Thomas Jungblut <thomas.jungblut@googlemail.com>
>
>> Cool idea, should we provide some simple producer/comsumer queue example
>> which gets information from the outside world?
>>  e.G. a twitter stream?
>>
>>
>> 2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>
>>
>>> +1 !
>>>
>>> Tommaso
>>>
>>> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
>>>
>>> > Hi,
>>> >
>>> > I just thought I'd share a little idea with you.
>>> >
>>> > Recently, I met some people who want to use Hama or already made
>>> > something. I expected only some large-scale/batch-oriented data
>>> > processing applications but heard very interesting use cases. One was
>>> > that a continuous processing using infinite loop in a bsp function of
>>> > each task.
>>> >
>>> > As you know, the real-time processing can be applied to various fields
>>> > e.g., trends, hot search keywords, traffic mornitoring .., etc. It'd
>>> > be nice if we can add some example to show how real-time applications
>>> > can be structured as a sequence of supersteps.
>>> >
>>> > --
>>> > Best Regards, Edward J. Yoon
>>> > @eddieyoon
>>> >
>>>
>>
>>
>>
>> --
>> Thomas Jungblut
>> Berlin <thomas.jungblut@gmail.com>
>>
>
>
>
> --
> Thomas Jungblut
> Berlin <thomas.jungblut@gmail.com>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message