falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesan Ramachandran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2030) Enforce time partition pattern in the data location path in feed definition
Date Thu, 16 Jun 2016 18:14:05 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15334361#comment-15334361
] 

Venkatesan Ramachandran commented on FALCON-2030:
-------------------------------------------------

Ok, I understand that we don't want to block any use cases by introducing this validation,
however the use case you explained above is not clear to me.

Especially, if the retention is deleting a set of files in the feed dir (there are no version
or date pattern sub-dirs), will that not affect the inflight workflow instance hadoop jobs/tasks
to fail? 

> Enforce time partition pattern in the data location path in feed definition 
> ----------------------------------------------------------------------------
>
>                 Key: FALCON-2030
>                 URL: https://issues.apache.org/jira/browse/FALCON-2030
>             Project: Falcon
>          Issue Type: Improvement
>          Components: feed
>            Reporter: Venkatesan Ramachandran
>            Assignee: Venkatesan Ramachandran
>
> In feed definition, data location can be specified without time series pattern like below:
>    <locations>
>         <location type="data" path="/tmp/falcon-regression/RetentionTest/testFolders/"/>
>         <location type="stats" path="/projects/falcon/clicksStats"/>
>         <location type="meta" path="/projects/falcon/clicksMetaData"/>
>     </locations>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message