falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FALCON-583) Post processing is broken in current trunk
Date Mon, 18 Aug 2014 08:49:19 GMT

    [ https://issues.apache.org/jira/browse/FALCON-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100439#comment-14100439
] 

Shwetha G S edited comment on FALCON-583 at 8/18/14 8:47 AM:
-------------------------------------------------------------

Sorry about that. I have tested this and it works:
{code}        <arg>${wf:lastErrorNode() == null ? 'SUCCEEDED' : 'FAILED'}</arg>
{code}

According to oozie doc http://oozie.apache.org/docs/4.0.1/WorkflowFunctionalSpec.html#a4.2.3_Workflow_EL_Functions,
String wf:lastErrorNode()

It returns the name of the last workflow action node that exit with an ERROR exit state, or
an empty string if no a ction has exited with ERROR state in the current workflow job.

But according to oozie code, 
{code}
    /**
     * Return the name of the last action that ended in error.
     *
     * @return the name of the last action that ended in error, <code>null</code>
if no action in the workflow job has
     *         ended in error.
     */
    public static String wf_lastErrorNode() {
        return getWorkflow().getWorkflowInstance().getVar(LAST_ACTION_IN_ERROR);
    }
{code}


was (Author: shwethags):
Sorry about that. I have tested this and it works:
{code}        <arg>${wf:lastErrorNode() == null ? 'SUCCEEDED' : 'FAILED'}</arg>
{code}

According to oozie doc http://oozie.apache.org/docs/4.0.1/WorkflowFunctionalSpec.html#a4.2.3_Workflow_EL_Functions,
String wf:errorCode(String node)

It returns the error code for the specified action node, or an empty string if the action
node has not exited with ERROR state.

But according to oozie code, 
{code}
    /**
     * Return the name of the last action that ended in error.
     *
     * @return the name of the last action that ended in error, <code>null</code>
if no action in the workflow job has
     *         ended in error.
     */
    public static String wf_lastErrorNode() {
        return getWorkflow().getWorkflowInstance().getVar(LAST_ACTION_IN_ERROR);
    }
{code}

> Post processing is broken in current trunk
> ------------------------------------------
>
>                 Key: FALCON-583
>                 URL: https://issues.apache.org/jira/browse/FALCON-583
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.6
>            Reporter: Suhas Vasu
>            Assignee: Venkatesh Seetharam
>            Priority: Blocker
>             Fix For: 0.6
>
>         Attachments: FALCON-583-v1.patch, FALCON-583-v2.patch, FALCON-583.patch
>
>
> Currently falcon post-processing is broken.
> Checked it for the following instances:
> 1. A feed with hcat-replication
> 2. A MR process that reads from hadoop fs and writes to hadoop fs
> Both of the actions failed at x@succeeded-post-processing with the error 
> {noformat}
> Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.JavaMain], main()
threw exception, java.lang.NullPointerException
> org.apache.oozie.action.hadoop.JavaMainException: java.lang.NullPointerException
> 	at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:58)
> 	at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)
> 	at org.apache.oozie.action.hadoop.JavaMain.main(JavaMain.java:36)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:226)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.lang.NullPointerException
> 	at org.apache.commons.cli.GnuParser.flatten(GnuParser.java:68)
> 	at org.apache.commons.cli.Parser.parse(Parser.java:161)
> 	at org.apache.commons.cli.Parser.parse(Parser.java:119)
> 	at org.apache.falcon.workflow.WorkflowExecutionContext.getCommand(WorkflowExecutionContext.java:337)
> 	at org.apache.falcon.workflow.WorkflowExecutionContext.create(WorkflowExecutionContext.java:311)
> 	at org.apache.falcon.workflow.FalconPostProcessing.run(FalconPostProcessing.java:43)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> 	at org.apache.falcon.workflow.FalconPostProcessing.main(FalconPostProcessing.java:37)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:55)
> 	... 15 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message