falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajay Yadava (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FALCON-2030) Enforce time partition pattern in the data location path in feed definition
Date Fri, 17 Jun 2016 06:33:05 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335368#comment-15335368
] 

Ajay Yadava edited comment on FALCON-2030 at 6/17/16 6:32 AM:
--------------------------------------------------------------

Retention deletes on the basis of creation time or last accessed time. Like retention the
consumers, *if any* exist, will also have to consume only on the base of creation time/access
time to avoid consuming files scheduled for deletion. Use case may also be as simple as a
way to automatically delete temporary/unused files/directories from a location and no consumers
as such. 


was (Author: ajayyadava):
Retention deletes on the basis of creation time or last accessed time. Like retention the
consumers, *if any* exist, will also have to consume only on the base of creation time/access
time to avoid deletion. Use case may also be as simple as a way to automatically delete temporary/unused
files/directories from a location. 

> Enforce time partition pattern in the data location path in feed definition 
> ----------------------------------------------------------------------------
>
>                 Key: FALCON-2030
>                 URL: https://issues.apache.org/jira/browse/FALCON-2030
>             Project: Falcon
>          Issue Type: Improvement
>          Components: feed
>            Reporter: Venkatesan Ramachandran
>            Assignee: Venkatesan Ramachandran
>
> In feed definition, data location can be specified without time series pattern like below:
>    <locations>
>         <location type="data" path="/tmp/falcon-regression/RetentionTest/testFolders/"/>
>         <location type="stats" path="/projects/falcon/clicksStats"/>
>         <location type="meta" path="/projects/falcon/clicksMetaData"/>
>     </locations>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message