crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-375) Implement Crunch on top of Apache Storm
Date Fri, 11 Apr 2014 06:17:17 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966276#comment-13966276
] 

Gabriel Reid commented on CRUNCH-375:
-------------------------------------

Sounds interesting -- I know that [~jwills] mentioned interest in doing something along these
lines in the past as well.

Could you elaborate a bit on how you would see this working? I don't know all that much about
Storm, but I'm thinking there are probably quite a few different ways to interpret how Crunch
could be run on top of Storm.

> Implement Crunch on top of Apache Storm
> ---------------------------------------
>
>                 Key: CRUNCH-375
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-375
>             Project: Crunch
>          Issue Type: Wish
>          Components: Core
>            Reporter: Corey J. Nolet
>            Assignee: Josh Wills
>              Labels: proposal
>
> I'm proposing this as a way for Apache Storm users to be able to write their pipelines
and run them both over Storm and MapReduce. 
> There was movement on implementing Pig on Storm which established the ability to load/store
through Hadoop input/output formats on Storm.
> I think this feature would be well-accepted into the community.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message