pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4429) Add Pig alias information and Pig script to the DAG view in Tez UI
Date Fri, 22 May 2015 22:30:17 GMT

    [ https://issues.apache.org/jira/browse/PIG-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14556935#comment-14556935

Rohini Palaniswamy commented on PIG-4429:

The DAG info screen shot is cool.  Could you also attach a screen shot for the alias and features?

Can we change
 String vertexInfo = dagScriptInfo.getAliasLocation(tezOp) + dagScriptInfo.getPigFeatures(tezOp);

 String vertexInfo = dagScriptInfo.getAliasLocation(tezOp) + " (" + dagScriptInfo.getPigFeatures(tezOp)
+ ")" ; 

for differentiation.

> Add Pig alias information and Pig script to the DAG view in Tez UI
> ------------------------------------------------------------------
>                 Key: PIG-4429
>                 URL: https://issues.apache.org/jira/browse/PIG-4429
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Daniel Dai
>             Fix For: 0.15.0
>         Attachments: DagInfo.png, PIG-4429-1.patch, PIG-4429-2.patch
>   The DAG view displays vertex name, id, time duration, task and status information for
each vertex. It would be good to add the pig alias and feature (join, group by, etc) information
to a "Description" Field to give a clear idea of what that vertex is doing something similar
to Lipstick.  There was another suggestion to also have a "Code" section which can put part
of the pig script relevant to that. Or the full pig script could be just set at the DAG level
and users can go check on the alias with the pig script there.  Most of the time, when multiple
users are responsible for a pipeline it is easy to have the pig script also displayed instead
of having to go to svn and git to find the script. Easy for pig team during investigation
as well. Need to check on the memory constraints.

This message was sent by Atlassian JIRA

View raw message