incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-9) Add support for launching Scrunch pipelines from a REPL
Date Tue, 10 Jul 2012 07:30:33 GMT


Josh Wills commented on CRUNCH-9:

Kiyan-- thanks for doing this, I had a lot of fun playing with it this evening. I attached
a couple of revisions based on my experiences-- mostly fixing up some com.cloudera -> org.apache
references, standardizing the JarEntry addition code, and a change to the scrunch script that
puts the scrunch classpath ahead of the hadoop one to deal w/some weirdness around hadoop
interacting with avro1.7.0 that I will followup on the list. Take a look and let me know what
you think.
> Add support for launching Scrunch pipelines from a REPL
> -------------------------------------------------------
>                 Key: CRUNCH-9
>                 URL:
>             Project: Crunch
>          Issue Type: New Feature
>          Components: Scrunch
>            Reporter: Josh Wills
>         Attachments: CRUNCH-9.patch, CRUNCH-9a.patch
> It would be really, really cool and useful to be able to launch a Scrunch pipeline from
a Scala-based REPL, which was one of the killer apps for Cascade, Google's Scala-based wrapper
around FlumeJava.
> See the video from Scala Days 2011 for a reference:

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message