hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pi song" <pi.so...@gmail.com>
Subject Re: anyone working on stream processing?
Date Mon, 17 Mar 2008 23:59:58 GMT
As incremental update mechanism that utilizes sliding window concept, I
think it is fine.

But for real-time stream processing, I can foresee a lot of workarounds to
make it work using batch-oriented map/reduce.

Pi


On 3/18/08, Chris Olston <olston@yahoo-inc.com> wrote:
>
> As Utkarsh said, this is a road we started down a while back, but did
> not continue.
>
> If people have use-cases for stream processing in the pig/hadoop
> context, I'd like to hear about it.
>
> -Chris
>
>
> On Mar 17, 2008, at 1:54 PM, pi song wrote:
>
> > Dear everyone,
> >
> > I've just recognized this file  "TimeWindowSpec.java" in Pig. Is
> > anyone
> > currently working on stream processing?
> >
> > Cheers,
> > Pi
>
> --
> Christopher Olston, Ph.D.
> Sr. Research Scientist
> Yahoo! Research
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message