falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "karan kumar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-1223) Rerun does not gate on availability flag
Date Fri, 15 May 2015 10:12:59 GMT
karan kumar created FALCON-1223:

             Summary: Rerun does not gate on availability flag
                 Key: FALCON-1223
                 URL: https://issues.apache.org/jira/browse/FALCON-1223
             Project: Falcon
          Issue Type: Bug
            Reporter: karan kumar

So in my pipeline I have 2 processes A and B with retries

A has multiple oozie workflow actions .
B is dependent on one of the intermediate action output of A.
So while A is running B gets triggered  after A's intermediate action gets completed.

Now what happened was A 's last action got killed.
In the workflow of A i have a prepare statement which deletes all the output paths.
So on A's falcon retry  the prepare statement deleted all the output paths including the intermediate
action output path which was used by B.

This caused B to fail.

On rerun of B, the job fails after getting triggered saying no data found at path. So on rerun
falcon is not checking the availability flag again for the feeds.

This message was sent by Atlassian JIRA

View raw message