hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-948) [Usability] Relating pig script with MR jobs
Date Wed, 09 Sep 2009 21:01:59 GMT

    [ https://issues.apache.org/jira/browse/PIG-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753260#action_12753260
] 

Ashutosh Chauhan commented on PIG-948:
--------------------------------------

In this string, we are determining job-tracker address, port number and job-ids through apis,
so thats fine. 
I agree that hardcoding other parts of url ( jobdetails.jsp?jobid= ) is not the best way to
do it, as it will break the link if that web-url changes in later hadoop releases. But since
there is no way to programatically  get that url, I went ahead with this. If there is a way
to get that url programatically, let me know. If not, I think its useful enough to have it
like this and update it if it gets changed in later hadoop releases. 

> [Usability] Relating pig script with MR jobs
> --------------------------------------------
>
>                 Key: PIG-948
>                 URL: https://issues.apache.org/jira/browse/PIG-948
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>            Priority: Minor
>         Attachments: pig-948.patch
>
>
> Currently its hard to find a way to relate pig script with specific MR job. In a loaded
cluster with multiple simultaneous job submissions, its not easy to figure out which specific
MR jobs were launched for a given pig script. If Pig can provide this info, it will be useful
to debug and monitor the jobs resulting from a pig script.
> At the very least, Pig should be able to provide user the following information
> 1) Job id of the launched job.
> 2) Complete web url of jobtracker running this job. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message