crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-105) Add generation of Graphviz dot files to describe the pipeline job plan
Date Tue, 30 Oct 2012 22:02:14 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487286#comment-13487286
] 

Gabriel Reid commented on CRUNCH-105:
-------------------------------------

The current way to use it (without kicking off a run) is as follows:

  pipeline.plan();
  String dotFileContents = pipeline.getConfiguration().get(MSCRPlanner.PIPELINE_PLAN_DOTFILE);

The contents of the dot file can be converted to an image using the tools from graphviz.org.

I think it would be cool to have a more clear API to access the dot file contents instead
of just sticking them in the Configuration, although I think that's lower priority. 
                
> Add generation of Graphviz dot files to describe the pipeline job plan
> ----------------------------------------------------------------------
>
>                 Key: CRUNCH-105
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-105
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.4.0
>            Reporter: Gabriel Reid
>            Assignee: Gabriel Reid
>         Attachments: CRUNCH-105.patch, innerjoingraph.png
>
>
> It could be very useful to have the ability to create Graphviz[1] dot files[2] based
on the outcome of the planner. This could facilitate visualizing the full graph of DoFns as
well as jobs and mappers and reducers in a Crunch pipeline.
> [1] http://graphviz.org
> [2] http://en.wikipedia.org/wiki/DOT_language 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message