crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <>
Subject [jira] [Created] (CRUNCH-518) Can't build crunch-spark due to protobuf dependency
Date Fri, 08 May 2015 20:19:00 GMT
Gabriel Reid created CRUNCH-518:

             Summary: Can't build crunch-spark due to protobuf dependency
                 Key: CRUNCH-518
             Project: Crunch
          Issue Type: Bug
            Reporter: Gabriel Reid

When trying to build clean build, I get errors like the following from crunch-spark:
[ERROR] /Users/greid/development/apache-projects/crunch/crunch-spark/src/it/scala/org/apache/crunch/scrunch/spark/PageRankTest.scala:49:
error: bad symbolic reference. A signature in PTypeH.class refers to term protobuf
[ERROR] in package which is not available.
[ERROR] It may be completely missing from the current classpath, or the version on
[ERROR] the classpath might be incompatible with the version used when compiling PTypeH.class.
[ERROR]     prev.cogroup(out).map((url, v) => {

It seems that this is due to protobuf being referenced from PTypeH, but since it's in provided
scope in crunch-scrunch, it doesn't get pulled in when building crunch-spark.

This message was sent by Atlassian JIRA

View raw message