pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jiraposter@reviews.apache.org (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-1883) Pig's progress estimation should account for parallel job executions
Date Mon, 02 May 2011 20:43:03 GMT

    [ https://issues.apache.org/jira/browse/PIG-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027830#comment-13027830
] 

jiraposter@reviews.apache.org commented on PIG-1883:
----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/683/
-----------------------------------------------------------

Review request for pig.


Summary
-------

This is Laukik's patch for PIG-1883


This addresses bug PIG-1883.
    https://issues.apache.org/jira/browse/PIG-1883


Diffs
-----

  trunk/src/org/apache/pig/Main.java 1097661 
  trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/Launcher.java 1097661

  trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java
1097661 
  trunk/src/org/apache/pig/impl/plan/OperatorPlan.java 1097661 
  trunk/src/org/apache/pig/scripting/SyncProgressNotificationAdaptor.java 1097661 
  trunk/src/org/apache/pig/tools/pigstats/PigProgressNotificationListener.java 1097661 
  trunk/src/org/apache/pig/tools/pigstats/ScriptState.java 1097661 
  trunk/test/org/apache/pig/test/TestOperatorPlan.java 1097661 

Diff: https://reviews.apache.org/r/683/diff


Testing
-------


Thanks,

Alan



> Pig's progress estimation should account for parallel job executions
> --------------------------------------------------------------------
>
>                 Key: PIG-1883
>                 URL: https://issues.apache.org/jira/browse/PIG-1883
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Laukik Chitnis
>            Assignee: Laukik Chitnis
>         Attachments: PIG-1883-2.patch
>
>
> Currently, Pig's progress estimation is based on the percentage of jobs completed out
of the total number of MR jobs. However, since the MR operators are arranged in a DAG (and
hence more than 1 job might be submitted for execution in parallel), the progress estimation
can be improved by considering the number of jobs in the critical path, instead of just the
total number of jobs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message