spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guoqiang Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1698) Improve spark integration
Date Fri, 02 May 2014 13:53:14 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987708#comment-13987708
] 

Guoqiang Li commented on SPARK-1698:
------------------------------------

[~srowen]
In [The PR 598|https://github.com/apache/spark/pull/598] ,The directory structure of a spark
similar to hadoop 2.3.0.
There are three subcomponents: core,examples,hive,Their path is share/spark/core,share/spark/examples,share/spark/hive

> Improve spark integration
> -------------------------
>
>                 Key: SPARK-1698
>                 URL: https://issues.apache.org/jira/browse/SPARK-1698
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build, Deploy
>            Reporter: Guoqiang Li
>            Assignee: Guoqiang Li
>             Fix For: 1.0.0
>
>
> Use the shade plugin to create a big JAR with all the dependencies can cause a few problems
> 1. Missing jar's meta information
> 2. Some file is covered, eg: plugin.xml
> 3. Different versions of the jar may co-exist
> 4. Too big, java 6 does not support



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message