crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joseph Adler (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-217) Crunch PipelineResult objects do not capture failures
Date Mon, 10 Jun 2013 15:57:20 GMT
Joseph Adler created CRUNCH-217:
-----------------------------------

             Summary: Crunch PipelineResult objects do not capture failures
                 Key: CRUNCH-217
                 URL: https://issues.apache.org/jira/browse/CRUNCH-217
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.6.0
            Reporter: Joseph Adler
            Assignee: Josh Wills


We use Crunch within Azkaban (a scheduling a and workflow tool, similar to Oozie). We need
to be able to run a crunch pipeline from within another Java program, then test for success
using code like this:

{code}
    PipelineResult mainResult = mainPipeline.run();
    if (!mainResult.succeeded())
    {
        throw new Exception("Pipeline failed: " + mainPipeline.getName() + "\n");
    }
    return 0;
{code}

Currently, PipelineResult objects don't let you do this; the succeeded() method will always
return true. 

I have enclosed a patch that addresses this issue for in-memory and map-reduce pipelines.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message