mesos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bernardo Gomez Palacio (JIRA)" <>
Subject [jira] [Closed] (MESOS-1203) Shade protobuf dependency in Mesos Java library
Date Mon, 12 May 2014 19:03:16 GMT


Bernardo Gomez Palacio closed MESOS-1203.

       Resolution: Fixed
    Fix Version/s: 0.18.1

As described in Jira SPARK-1806  Spark now uses Mesos 0.18.1 with shaded protobufs.

> Shade protobuf dependency in Mesos Java library
> -----------------------------------------------
>                 Key: MESOS-1203
>                 URL:
>             Project: Mesos
>          Issue Type: Improvement
>          Components: build
>            Reporter: Patrick Wendell
>             Fix For: 0.18.1
> Mesos's Java library uses the protobuf library which is also used by Hadoop. Unfortunately
the protobuf library does not provide binary compatiblity between minor versions (for code
compiled against 2.4.1 and 2.5.0 cannot run together in a single JVM classlaoder) .
> This makes use of Mesos via it's Java API, something that is required for Spark and I'm
assuming other frameworks, fundamentally incompatible for certain Hadoop versions.
> Mesos could shade this jar using the maven shade plug-in. Take a look at the Parquet
project for an example of shading:
> Without this fix Java users won't be able to use Mesos (< 0.17) with newer versions
of Hadoop. Or Mesos 0.17+ with older versions of Hadoop.

This message was sent by Atlassian JIRA

View raw message