crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph Adler (JIRA)" <>
Subject [jira] [Created] (CRUNCH-217) Crunch PipelineResult objects do not capture failures
Date Mon, 10 Jun 2013 15:57:20 GMT
Joseph Adler created CRUNCH-217:

             Summary: Crunch PipelineResult objects do not capture failures
                 Key: CRUNCH-217
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.6.0
            Reporter: Joseph Adler
            Assignee: Josh Wills

We use Crunch within Azkaban (a scheduling a and workflow tool, similar to Oozie). We need
to be able to run a crunch pipeline from within another Java program, then test for success
using code like this:

    PipelineResult mainResult =;
    if (!mainResult.succeeded())
        throw new Exception("Pipeline failed: " + mainPipeline.getName() + "\n");
    return 0;

Currently, PipelineResult objects don't let you do this; the succeeded() method will always
return true. 

I have enclosed a patch that addresses this issue for in-memory and map-reduce pipelines.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message