falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajay Yadava (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1581) Retention corner case : Retention coordinator cannot be submitted to workflow engine
Date Tue, 03 Nov 2015 08:36:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986916#comment-14986916
] 

Ajay Yadava commented on FALCON-1581:
-------------------------------------

[~bvellanki] I am inclined to agree with you. It makes sense especially in case of ad-hoc
feeds. Just to be sure, I will check with [~sriksun] if it was a deliberate decision.

> Retention corner case : Retention coordinator cannot be submitted to workflow engine
> ------------------------------------------------------------------------------------
>
>                 Key: FALCON-1581
>                 URL: https://issues.apache.org/jira/browse/FALCON-1581
>             Project: Falcon
>          Issue Type: Bug
>          Components: feed, retention
>    Affects Versions: 0.8
>            Reporter: Balu Vellanki
>            Assignee: Ajay Yadava
>
> To reproduce this issue, submit a Feed entity as follows and let it run for a day. 
> {code}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <feed name="rawEmailFeed" description="Raw customer email feed" xmlns="uri:falcon:feed:0.1">
>     <tags>externalSystem=USWestEmailServers</tags>
>     <groups>churnAnalysisDataPipeline</groups>
>     <frequency>hours(1)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="hours(1)"/>
>     <clusters>
>         <cluster name="primaryCluster" type="source">
>             <validity start="2015-10-30T01:00Z" end="2015-10-30T10:00Z"/>
>             <retention limit="days(90)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/user/ambari-qa/falcon/demo/primary/input/enron/${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
>         <location type="stats" path="/"/>
>         <location type="meta" path="/"/>
>     </locations>
>     <ACL owner="ambari-qa" group="users" permission="0x755"/>
>     <schema location="/none" provider="/none"/>
> </feed>
> {code}
> The feed bundle will complete with status SUCCEEDED.  Now delete the feed in Falcon.
Submit another feed with same name. Falcon will not schedule retention coordinator in workflow
engine. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message