pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PIG-5305) Enable yarn-client mode execution of tests in Spark (1) mode
Date Fri, 15 Sep 2017 03:50:00 GMT

    [ https://issues.apache.org/jira/browse/PIG-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167284#comment-16167284
] 

liyunzhang_intel edited comment on PIG-5305 at 9/15/17 3:49 AM:
----------------------------------------------------------------

[~szita]: several suggestions
1. can we only add {{pigtest-jar}} to {{test-spark}} target in build.xml? I guess for {{test-tez}},
there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of {{test-tez}} as the
dependency of {{compile-test}} includes {{jar-simple}}. If my understanding is not right,
tell me.
2.please add comment {{added feature to re-initialize SparkContext when switching between
cluster and local mode PigServers}} on related code. 

Besides, is there any unit test failures if convert  {{SPARK_MASTER}} from "local" to "yarn-client"?


was (Author: kellyzly):
[~szita]: several suggestions
1. can we only add {{pigtest-jar}} to {{test-spark}} target in build.xml? I guess for {{test-tez}},
there is no need for {{pigtest-jar}}
meanwhile there is no need to add {{jar-simple}} in the dependency of {{test-tez}} as the
dependency of {{compile-test}} includes {{jar-simple}}. If my understanding is not right,
tell me.
2.please add comment {{added feature to re-initialize SparkContext when switching between
cluster and local mode PigServers}} on related code. 

Besides, is there any unit test failures if convert  {{SPARK_MASTER}} from "local" to "yarn-client"?

> Enable yarn-client mode execution of tests in Spark (1) mode
> ------------------------------------------------------------
>
>                 Key: PIG-5305
>                 URL: https://issues.apache.org/jira/browse/PIG-5305
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Adam Szita
>            Assignee: Adam Szita
>         Attachments: PIG-5305.0.patch
>
>
> See parent jira (PIG-5305) for problem description



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message