spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
Date Thu, 19 Feb 2015 19:34:15 GMT


Sean Owen commented on SPARK-5669:

Aha, that's a good point. I'm still not clear if this exception covers the usage in Spark,
given the definition of "Eligible Compilation Process":

A Compilation Process is "Eligible" if it is done using GCC, alone or with other GPL-compatible
software, or if it is done without using any work based on GCC. ...

Here the Target Work is just put together with bundling. It doesn't seem quite in the spirit
of this exemption as I understand it, but it's done without using any work based on GCC,"
at least I think.

Well, regardless, my thinking was that there was already momentum to standardize on one library,
so erring on the side of caution regarding licenses, and excising JBLAS also solves that problem.
Also, since 1.3 we don't even use the native libraries anyway. Do you think it's best to continue
down this road anyway, removing the native libs at least and likely JBLAS?

> Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS
> --------------------------------------------------------------------------------
>                 Key: SPARK-5669
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>            Reporter: Sean Owen
>            Assignee: Sean Owen
>            Priority: Blocker
>             Fix For: 1.3.0
> Sorry for "Blocker", but it's a license issue. The Spark assembly includes the following,
from JBLAS:
> {code}
> lib/
> lib/static/
> lib/static/Mac OS X/
> lib/static/Mac OS X/x86_64/
> lib/static/Mac OS X/x86_64/libjblas_arch_flavor.jnilib
> lib/static/Mac OS X/x86_64/sse3/
> lib/static/Mac OS X/x86_64/sse3/libjblas.jnilib
> lib/static/Windows/
> lib/static/Windows/x86/
> lib/static/Windows/x86/libgfortran-3.dll
> lib/static/Windows/x86/libgcc_s_dw2-1.dll
> lib/static/Windows/x86/jblas_arch_flavor.dll
> lib/static/Windows/x86/sse3/
> lib/static/Windows/x86/sse3/jblas.dll
> lib/static/Windows/amd64/
> lib/static/Windows/amd64/libgfortran-3.dll
> lib/static/Windows/amd64/jblas.dll
> lib/static/Windows/amd64/libgcc_s_sjlj-1.dll
> lib/static/Windows/amd64/jblas_arch_flavor.dll
> lib/static/Linux/
> lib/static/Linux/i386/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/sse3/
> lib/static/Linux/i386/
> lib/static/Linux/amd64/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/sse3/
> lib/static/Linux/amd64/
> {code}
> Unfortunately the libgfortran and libgcc libraries included for Windows are not licensed
in a way that's compatible with Spark and the AL2 -- LGPL at least.
> It's easy to exclude them. I'm not clear what it does to running on Windows; I assume
it can still work but the libs would have to be made available locally and put on the shared
library path manually. I don't think there's a package manager as in Linux that would make
it easily available. I'm not able to test on Windows.
> If it doesn't work, the follow-up question is whether that means JBLAS has to be removed
on the double, or treated as a known issue for 1.3.0.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message