spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Favio Vázquez (JIRA) <j...@apache.org>
Subject [jira] [Created] (SPARK-7238) Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0
Date Wed, 29 Apr 2015 18:04:06 GMT
Favio Vázquez created SPARK-7238:
------------------------------------

             Summary: Upgrade protobuf-java (com.google.protobuf) version from 2.4.1 to 2.5.0
                 Key: SPARK-7238
                 URL: https://issues.apache.org/jira/browse/SPARK-7238
             Project: Spark
          Issue Type: Dependency upgrade
          Components: Build
    Affects Versions: 1.3.1
         Environment: Ubuntu 14.04. Apache Mesos in cluster mode with  HDFS from cloudera
2.5.0-cdh5.3.3. 
            Reporter: Favio Vázquez
            Priority: Blocker
             Fix For: 1.3.1, 1.3.0


This upgrade is needed when building spark for CDH5  2.5.0-cdh5.3.3 due to incompatibilities
in the protobuf version used by com.google.protobuf and the one used in hadoop. The default
version of protobuf is set to 2.4.1 in the global properties, and this is stated in the pom.xml
file:

<!-- In theory we need not directly depend on protobuf since Spark does not directly use
it. However, when building with Hadoop/YARN 2.2 Maven doesn't correctly bump the protobuf
version up from the one Mesos gives. For now we include this variable to explicitly bump the
version when building with YARN. It would be nice to figure out why Maven can't resolve this
correctly (like SBT does). -->

So this upgrade will only be affecting the com.google.protobuf version of java-protobuf. Tested
for the Cloudera distribution 2.5.0-cdh5.3.3 using Mesos 0.22.0 in cluster mode.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message