crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-518) Can't build crunch-spark due to protobuf dependency
Date Fri, 08 May 2015 21:33:00 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535599#comment-14535599
] 

Josh Wills commented on CRUNCH-518:
-----------------------------------

Cool-- I'll put this one in, along with 509 and 517, and then prep the release. Thanks man,
it was good to see you in person this week!

> Can't build crunch-spark due to protobuf dependency
> ---------------------------------------------------
>
>                 Key: CRUNCH-518
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-518
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Gabriel Reid
>         Attachments: CRUNCH-518.patch
>
>
> When trying to build clean build, I get errors like the following from crunch-spark:
> {code}
> [ERROR] /Users/greid/development/apache-projects/crunch/crunch-spark/src/it/scala/org/apache/crunch/scrunch/spark/PageRankTest.scala:49:
error: bad symbolic reference. A signature in PTypeH.class refers to term protobuf
> [ERROR] in package com.google which is not available.
> [ERROR] It may be completely missing from the current classpath, or the version on
> [ERROR] the classpath might be incompatible with the version used when compiling PTypeH.class.
> [ERROR]     prev.cogroup(out).map((url, v) => {
> {code}
> It seems that this is due to protobuf being referenced from PTypeH, but since it's in
provided scope in crunch-scrunch, it doesn't get pulled in when building crunch-spark.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message