pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PIG-5081) Can not run pig on spark source code distribution
Date Thu, 22 Dec 2016 03:05:06 GMT

    [ https://issues.apache.org/jira/browse/PIG-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15768848#comment-15768848
] 

Jeff Zhang edited comment on PIG-5081 at 12/22/16 3:04 AM:
-----------------------------------------------------------

[~kellyzly] Thanks for review.  I mean spark 1.6 source code distribution not spark master.
I know Spark 2.x has some differences on assembly jar.  The spark assembly jar is under  assembly/target/scala-2.10/
for spark 1.6.  We could run sparksubmit in spark source code distribution, so I think we
should enable that for pig as well. This could help us to test pig on the latest version of
spark. 


was (Author: zjffdu):
[~kellyzly] Thanks for review.  I mean spark 1.6 source code distribution not spark master.
I know Spark 2.x has some differences on assembly jar.  The spark assembly jar is under  assembly/target/scala-2.10/
for spark 1.6.  We could run sparksubmit in source code distribution, so I think we should
enable that for pig as well. This could help us to test pig on the latest version of spark.


> Can not run pig on spark source code distribution
> -------------------------------------------------
>
>                 Key: PIG-5081
>                 URL: https://issues.apache.org/jira/browse/PIG-5081
>             Project: Pig
>          Issue Type: Bug
>          Components: spark
>    Affects Versions: 0.16.0
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>            Priority: Minor
>         Attachments: PIG_5081_1.patch
>
>
> This is due to spark assembly jar is not found for spark source code distribution



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message