falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré ...@nanthrax.net>
Subject Falcon with Spark ?
Date Tue, 03 Feb 2015 14:51:38 GMT
Hi all,

I'm working (and finally resuming my work ;)) on some Falcon features:
- Update and improvements on the ActiveMQ broker
- Complete CDC support of diff/gap storage
- Support of more workflow entities (mapreduce directly instead of Oozie 
workflow.xml, etc)

For the workflow entities, I would like to evaluate the "direct" support 
of Spark.
Generally speaking, I wonder if "oppositionally", we couldn't leverage 
Spark for some internal Falcon processes (like eviction, etc).

WDYT ?

Regards
JB
-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Mime
View raw message