pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-3365) Run as uber job if there is only one input split
Date Mon, 01 Jul 2013 20:28:20 GMT

    [ https://issues.apache.org/jira/browse/PIG-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13697135#comment-13697135
] 

Rohini Palaniswamy commented on PIG-3365:
-----------------------------------------

We should automatically set this property for jobs that have 1 input split. We should also
have a way to turn off pig doing that as uber jobs are not that quite stable yet and might
hit issues with hadoop. 
                
> Run as uber job if there is only one input split
> ------------------------------------------------
>
>                 Key: PIG-3365
>                 URL: https://issues.apache.org/jira/browse/PIG-3365
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>              Labels: Performance
>
> Hadoop 2 has support for uber mode (mapreduce.job.ubertask.enable=true) which runs the
map and reduce on Application Master itself and reduces the overhead of launching a separate
map/reduce task. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message