falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1581) Retention corner case : Retention coordinator cannot be submitted to workflow engine
Date Tue, 03 Nov 2015 06:26:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986766#comment-14986766
] 

Peeyush Bishnoi commented on FALCON-1581:
-----------------------------------------

[~bvellanki] Even I have experienced the similar issue many times with same entity name. In
my case it happens when deletion of entity is in progress and submission of entity happens
immediately during deletion time. But on trying again scheduling of entity succeeds.

> Retention corner case : Retention coordinator cannot be submitted to workflow engine
> ------------------------------------------------------------------------------------
>
>                 Key: FALCON-1581
>                 URL: https://issues.apache.org/jira/browse/FALCON-1581
>             Project: Falcon
>          Issue Type: Bug
>          Components: feed, retention
>    Affects Versions: 0.8
>            Reporter: Balu Vellanki
>
> To reproduce this issue, submit a Feed entity as follows and let it run for a day. 
> {code}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <feed name="rawEmailFeed" description="Raw customer email feed" xmlns="uri:falcon:feed:0.1">
>     <tags>externalSystem=USWestEmailServers</tags>
>     <groups>churnAnalysisDataPipeline</groups>
>     <frequency>hours(1)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="hours(1)"/>
>     <clusters>
>         <cluster name="primaryCluster" type="source">
>             <validity start="2015-10-30T01:00Z" end="2015-10-30T10:00Z"/>
>             <retention limit="days(90)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/user/ambari-qa/falcon/demo/primary/input/enron/${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
>         <location type="stats" path="/"/>
>         <location type="meta" path="/"/>
>     </locations>
>     <ACL owner="ambari-qa" group="users" permission="0x755"/>
>     <schema location="/none" provider="/none"/>
> </feed>
> {code}
> The feed bundle will complete with status SUCCEEDED.  Now delete the feed in Falcon.
Submit another feed with same name. Falcon will not schedule retention coordinator in workflow
engine. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message