crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Wills <>
Subject Re: Scrunch example project with SBT?
Date Thu, 19 Jun 2014 22:03:30 GMT
Here you go:

Did this w/Maven; you'll have to forgive me as my SBT-fu isn't great. It
looks like vanilla Hadoop 1.x doesn't include any thrift/protobuf
dependencies that Scrunch expects to be present at compile-time; I added
them as provided dependencies in this example and then verified that I
could run the -job.jar that I built w/mvn package under Hadoop 1.0.3.


On Thu, Jun 19, 2014 at 2:33 PM, Daniel Siegmann <>

> Hi Josh, thanks for the reply.
>  Which version of Hadoop are you looking to compile against?
> I think any 1.x version will suffice (our production cluster is MapR).
> The Spotify comparison is interesting. Too bad they didn't evaluate Scoobi
> as well. Thanks for the info.

Director of Data Science
Cloudera <>
Twitter: @josh_wills <>

View raw message