mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bernardo Gomez Palacio (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MESOS-1069) Branch for 0.16.0 with Protobufs 2.5.0
Date Mon, 12 May 2014 21:52:15 GMT

    [ https://issues.apache.org/jira/browse/MESOS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995687#comment-13995687
] 

Bernardo Gomez Palacio commented on MESOS-1069:
-----------------------------------------------

Since Mesos 0.18.1 we now supports protobuf shading which enables Mesos to keep the protobuf
version internal through the `org.apache.mesos.protobuf` namespace. This enables Mesos to
work with protobuf versions that are externalized by other libraries.

Using the shaded artifact:

Maven.
{code}
<dependency>
         <groupId>org.apache.mesos</groupId>
          <artifactId>mesos</artifactId>
          <version>${mesos.version}</version>
         <classifier>${mesos.classifier}</classifier>
         <exclusions>
           <exclusion>
             <groupId>com.google.protobuf</groupId>
             <artifactId>protobuf-java</artifactId>
           </exclusion>
         </exclusions>
 </dependency>
{code}

SBT
{code}
"org.apache.mesos"           % "mesos"            % "0.18.1" classifier("shaded-protobuf")
exclude("com.google.protobuf", "protobuf-java")
{code}

In your Java code.
{code}
import com.google.protobuf.ByteString
//instead of import org.apache.mesos.protobuf.ByteString
{code}

> Branch for 0.16.0 with Protobufs 2.5.0
> --------------------------------------
>
>                 Key: MESOS-1069
>                 URL: https://issues.apache.org/jira/browse/MESOS-1069
>             Project: Mesos
>          Issue Type: Improvement
>    Affects Versions: 0.16.0
>            Reporter: Bernardo Gomez Palacio
>            Assignee: Bernardo Gomez Palacio
>             Fix For: 0.17.0
>
>
> If you deploy Mesos 0.16.0 on a Hadoop 2.x cluster with Spark 0.9.0+ you will start getting
stack-dumps similar to [dump.log|https://gist.github.com/berngp/c16c56516cb40d9a78fe]
> Without going into much detail the hadoop-client.jar for 2.x now requires
> Protobuf 2.5.0 and therefore Spark will require the same protobuf
> version. Due this you will need to run Spark on Mesos with support of
> Protobuf 2.5.0.
> If you want to use Mesos 0.16.0, which is the latest stable release, you will need support
of Protobufs 2.5.0 on Mesos 0.16.0.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message