incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tommaso Teofili <tommaso.teof...@gmail.com>
Subject Re: Real-time processing with Hama
Date Thu, 13 Oct 2011 13:08:57 GMT
+1 really cool indeed Thomas, thanks :)
Tommaso

2011/10/13 Edward J. Yoon <edwardyoon@apache.org>

> +1 Looks good to me.
>
> Let's update examples wiki pages first.
>
> On Thu, Oct 13, 2011 at 8:50 PM, Thomas Jungblut
> <thomas.jungblut@googlemail.com> wrote:
> > You may already read it on twitter, I made a little BSP for this:
> >
> >
> https://github.com/thomasjungblut/thomasjungblut-common/blob/master/src/de/jungblut/bsp/DataStreamProcessing.java
> >
> > Maybe we can integrate this as an example? I would replace the
> while(true)
> > loop with a finite amount of tweets to process. And if a user does not
> give
> > an account, use a global timeline.
> > Anything we should add for real time processing?
> >
> > 2011/10/13 Thomas Jungblut <thomas.jungblut@googlemail.com>
> >
> >> Cool idea, should we provide some simple producer/comsumer queue example
> >> which gets information from the outside world?
> >>  e.G. a twitter stream?
> >>
> >>
> >> 2011/10/13 Tommaso Teofili <tommaso.teofili@gmail.com>
> >>
> >>> +1 !
> >>>
> >>> Tommaso
> >>>
> >>> 2011/10/13 Edward J. Yoon <edwardyoon@apache.org>
> >>>
> >>> > Hi,
> >>> >
> >>> > I just thought I'd share a little idea with you.
> >>> >
> >>> > Recently, I met some people who want to use Hama or already made
> >>> > something. I expected only some large-scale/batch-oriented data
> >>> > processing applications but heard very interesting use cases. One was
> >>> > that a continuous processing using infinite loop in a bsp function
of
> >>> > each task.
> >>> >
> >>> > As you know, the real-time processing can be applied to various
> fields
> >>> > e.g., trends, hot search keywords, traffic mornitoring .., etc. It'd
> >>> > be nice if we can add some example to show how real-time applications
> >>> > can be structured as a sequence of supersteps.
> >>> >
> >>> > --
> >>> > Best Regards, Edward J. Yoon
> >>> > @eddieyoon
> >>> >
> >>>
> >>
> >>
> >>
> >> --
> >> Thomas Jungblut
> >> Berlin <thomas.jungblut@gmail.com>
> >>
> >
> >
> >
> > --
> > Thomas Jungblut
> > Berlin <thomas.jungblut@gmail.com>
> >
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message