pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Szita (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-5178) Fix configuration for E2E spark mode
Date Thu, 09 Mar 2017 09:10:38 GMT

    [ https://issues.apache.org/jira/browse/PIG-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902726#comment-15902726
] 

Adam Szita commented on PIG-5178:
---------------------------------

[~kellyzly] We've noticed several OutOfMemory issues while running e2e tests, all of them
relating to Perm space. The setting in the patch sets the maximum size of Perm, it is not
a minimum requirement. (And we'll probably remove this in the future once we drop support
for java 7 and use java 8 only)
As for the _inpathbase_, I think it should be aligned with the MR and Tez execution mode tests.
See for example: https://github.com/apache/pig/blob/trunk/test/e2e/pig/conf/tez.conf#L33

> Fix configuration for E2E spark mode
> ------------------------------------
>
>                 Key: PIG-5178
>                 URL: https://issues.apache.org/jira/browse/PIG-5178
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Adam Szita
>            Assignee: Adam Szita
>             Fix For: spark-branch
>
>         Attachments: PIG-5178.0.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message