falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré ...@nanthrax.net>
Subject Re: Streaming Feed
Date Wed, 11 Feb 2015 09:04:51 GMT
Hi Sharad,

I sent an e-mail last week about support of Spark (SparkStreaming) in 
workflow/process. It's basically very close to what you propose.

IMHO, it should be a new impl of workflow or at least the support of a 
new kind of processes (it's what I have in mind).

Regards
JB

On 02/11/2015 09:38 AM, Sharad Agarwal wrote:
> I am looking for a generic schema aware feed construct for streaming
> workflow. The schema can be managed by a catalog service like HCatalog. The
> streaming workflow executor would be a system like
> Storm/SparkStreaming/Samza.
>
> I want to know if this is the right thing to be supported in Falcon and if
> yes what is the plugging interface for that. Would this be a new
> implementation of workflow engine ?
>
> Thanks
> Sharad
>

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Mime
View raw message