falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1834) Allow stream entities and support stream processing in Falcon processes
Date Thu, 18 Feb 2016 06:19:18 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151792#comment-15151792
] 

Pallavi Rao commented on FALCON-1834:
-------------------------------------

Most big data processing involves both stream processing and batch processing. Falcon can
be enhanced to add a new "stream" entity. Users should then be able to define a process that
consumes from a stream input, and processes data on a user provided stream processing engine
(storm, spark-streaming). The process should be able to output to either a stream entity or
a feed.

Initially, the value add this will bring is that all of the users' datasets, processing and
schemas can be managed and operated using a single platform.

> Allow stream entities and support stream processing in Falcon processes
> -----------------------------------------------------------------------
>
>                 Key: FALCON-1834
>                 URL: https://issues.apache.org/jira/browse/FALCON-1834
>             Project: Falcon
>          Issue Type: New Feature
>          Components: general
>            Reporter: Pallavi Rao
>              Labels: gsoc2016
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message