incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Re: Real-time processing with Hama
Date Fri, 14 Oct 2011 02:10:27 GMT
Okay, I'll.

On Thu, Oct 13, 2011 at 10:33 PM, Thomas Jungblut
<thomas.jungblut@googlemail.com> wrote:
> Thanks to the guy who had the idea.
> Will you make a real-time example document in the Wiki Edward? If you don't
> have the time, I can write a few sentences then.
>
> 2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>
>
>> +1 really cool indeed Thomas, thanks :)
>> Tommaso
>>
>> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
>>
>> > +1 Looks good to me.
>> >
>> > Let's update examples wiki pages first.
>> >
>> > On Thu, Oct 13, 2011 at 8:50 PM, Thomas Jungblut
>> > <thomas.jungblut@googlemail.com> wrote:
>> > > You may already read it on twitter, I made a little BSP for this:
>> > >
>> > >
>> >
>> https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/bsp/DataStreamProcessing.java
>> > >
>> > > Maybe we can integrate this as an example? I would replace the
>> > while(true)
>> > > loop with a finite amount of tweets to process. And if a user does not
>> > give
>> > > an account, use a global timeline.
>> > > Anything we should add for real time processing?
>> > >
>> > > 2011/10/13 Thomas Jungblut <thomas.jungblut@googlemail.com>
>> > >
>> > >> Cool idea, should we provide some simple producer/comsumer queue
>> example
>> > >> which gets information from the outside world?
>> > >>  e.G. a twitter stream?
>> > >>
>> > >>
>> > >> 2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>
>> > >>
>> > >>> +1 !
>> > >>>
>> > >>> Tommaso
>> > >>>
>> > >>> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
>> > >>>
>> > >>> > Hi,
>> > >>> >
>> > >>> > I just thought I'd share a little idea with you.
>> > >>> >
>> > >>> > Recently, I met some people who want to use Hama or already
made
>> > >>> > something. I expected only some large-scale/batch-oriented
data
>> > >>> > processing applications but heard very interesting use cases.
One
>> was
>> > >>> > that a continuous processing using infinite loop in a bsp
function
>> of
>> > >>> > each task.
>> > >>> >
>> > >>> > As you know, the real-time processing can be applied to various
>> > fields
>> > >>> > e.g., trends, hot search keywords, traffic mornitoring ..,
etc.
>> It'd
>> > >>> > be nice if we can add some example to show how real-time
>> applications
>> > >>> > can be structured as a sequence of supersteps.
>> > >>> >
>> > >>> > --
>> > >>> > Best Regards, Edward J. Yoon
>> > >>> > @eddieyoon
>> > >>> >
>> > >>>
>> > >>
>> > >>
>> > >>
>> > >> --
>> > >> Thomas Jungblut
>> > >> Berlin <thomas.jungblut@gmail.com>
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > > Thomas Jungblut
>> > > Berlin <thomas.jungblut@gmail.com>
>> > >
>> >
>> >
>> >
>> > --
>> > Best Regards, Edward J. Yoon
>> > @eddieyoon
>> >
>>
>
>
>
> --
> Thomas Jungblut
> Berlin <thomas.jungblut@gmail.com>
>



-- 
Best Regards, Edward J. Yoon
@eddieyoon

Mime
View raw message