crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-418) Auto-logging Plan
Date Fri, 13 Jun 2014 23:12:01 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031313#comment-14031313
] 

Josh Wills commented on CRUNCH-418:
-----------------------------------

On MRPipeline, you can also do:

MRPipeline mrp = ...;

MRExecutor executor = mrp.plan();
System.out.println(executor.getPlanDotFile());
Futures.addCallback(executor, new SomeCallbackToCallCleanupOnPipelineWhenThisThingFinishes());
executor.execute(); // executor gonna execute
... etc.

> Auto-logging Plan
> -----------------
>
>                 Key: CRUNCH-418
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-418
>             Project: Crunch
>          Issue Type: Wish
>            Reporter: Allan Shoup
>            Priority: Minor
>
> It would be handy if Crunch was capable of logging out the plan DOT diagram automatically
whenever the pipeline was run.
> By default I would log the plan at a level below INFO - probably at DEBUG.
> Additionally, configuration could be provided to specify the level that the plan should
be logged at (for example if you always wanted it logged at INFO level, or if you wanted to
disable logging the plan altogether).



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message