incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Jungblut <thomas.jungb...@googlemail.com>
Subject Re: Real-time processing with Hama
Date Thu, 13 Oct 2011 13:33:13 GMT
Thanks to the guy who had the idea.
Will you make a real-time example document in the Wiki Edward? If you don't
have the time, I can write a few sentences then.

2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>

> +1 really cool indeed Thomas, thanks :)
> Tommaso
>
> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
>
> > +1 Looks good to me.
> >
> > Let's update examples wiki pages first.
> >
> > On Thu, Oct 13, 2011 at 8:50 PM, Thomas Jungblut
> > <thomas.jungblut@googlemail.com> wrote:
> > > You may already read it on twitter, I made a little BSP for this:
> > >
> > >
> >
> https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/bsp/DataStreamProcessing.java
> > >
> > > Maybe we can integrate this as an example? I would replace the
> > while(true)
> > > loop with a finite amount of tweets to process. And if a user does not
> > give
> > > an account, use a global timeline.
> > > Anything we should add for real time processing?
> > >
> > > 2011/10/13 Thomas Jungblut <thomas.jungblut@googlemail.com>
> > >
> > >> Cool idea, should we provide some simple producer/comsumer queue
> example
> > >> which gets information from the outside world?
> > >>  e.G. a twitter stream?
> > >>
> > >>
> > >> 2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>
> > >>
> > >>> +1 !
> > >>>
> > >>> Tommaso
> > >>>
> > >>> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
> > >>>
> > >>> > Hi,
> > >>> >
> > >>> > I just thought I'd share a little idea with you.
> > >>> >
> > >>> > Recently, I met some people who want to use Hama or already made
> > >>> > something. I expected only some large-scale/batch-oriented data
> > >>> > processing applications but heard very interesting use cases.
One
> was
> > >>> > that a continuous processing using infinite loop in a bsp function
> of
> > >>> > each task.
> > >>> >
> > >>> > As you know, the real-time processing can be applied to various
> > fields
> > >>> > e.g., trends, hot search keywords, traffic mornitoring .., etc.
> It'd
> > >>> > be nice if we can add some example to show how real-time
> applications
> > >>> > can be structured as a sequence of supersteps.
> > >>> >
> > >>> > --
> > >>> > Best Regards, Edward J. Yoon
> > >>> > @eddieyoon
> > >>> >
> > >>>
> > >>
> > >>
> > >>
> > >> --
> > >> Thomas Jungblut
> > >> Berlin <thomas.jungblut@gmail.com>
> > >>
> > >
> > >
> > >
> > > --
> > > Thomas Jungblut
> > > Berlin <thomas.jungblut@gmail.com>
> > >
> >
> >
> >
> > --
> > Best Regards, Edward J. Yoon
> > @eddieyoon
> >
>



-- 
Thomas Jungblut
Berlin <thomas.jungblut@gmail.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message