pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (PIG-5157) Upgrade to Spark 2.0
Date Fri, 23 Jun 2017 08:30:00 GMT

    [ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060574#comment-16060574
] 

liyunzhang_intel edited comment on PIG-5157 at 6/23/17 8:29 AM:
----------------------------------------------------------------

[~nkollar]:looks good, but met some problem when testing in local and yarn-client, give me
more time to verify the problem is caused by the configuration or others. thanks!
after using this patch,  the result of unit test
{code}
 ant  -Dtest.junit.output.format=xml clean  -Dtestcase=TestGrunt  -Dexectype=spark  -Dhadoopversion=2
 test

{code}
the result:
{noformat}
Tests run: 67, Failures: 1, Errors: 5, Skipped: 4, Time elapsed: 138.459 sec

{noformat}

I will investigate the reason in my env but can you verify it in your env?


was (Author: kellyzly):
[~nkollar]:looks good, but met some problem when testing in local and yarn-client, give me
more time to verify the problem is caused by the configuration or others. thanks!
after using this patch,  the result of unit test
{code}
 ant  -Dtest.junit.output.format=xml clean  -Dtestcase=TestGrunt  -Dexectype=spark  -Dhadoopversion=2
 test

{code}
the result:
{noformat}
Tests run: 67, Failures: 1, Errors: 5, Skipped: 4, Time elapsed: 138.459 sec

{noformat}

> Upgrade to Spark 2.0
> --------------------
>
>                 Key: PIG-5157
>                 URL: https://issues.apache.org/jira/browse/PIG-5157
>             Project: Pig
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Nandor Kollar
>            Assignee: Nandor Kollar
>             Fix For: 0.18.0
>
>         Attachments: PIG-5157.patch
>
>
> Upgrade to Spark 2.0 (or latest)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message