pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-5332) Implement auto parallelism for pig on spark
Date Thu, 15 Mar 2018 01:20:00 GMT
liyunzhang created PIG-5332:
-------------------------------

             Summary: Implement auto parallelism for pig on spark
                 Key: PIG-5332
                 URL: https://issues.apache.org/jira/browse/PIG-5332
             Project: Pig
          Issue Type: Bug
            Reporter: liyunzhang


Currently, pig on spark use {{pig.exec.reducers.max}} as reduce number. It is better to have
auto parallelism and not let end-users to calculate the reduce number.  Pig on tez implementation
is in PIG-4434



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message