falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sowmya Ramesh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1560) Lifecycle does not allow feed with frequency greater than days(1)
Date Thu, 29 Oct 2015 06:09:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979892#comment-14979892
] 

Sowmya Ramesh commented on FALCON-1560:
---------------------------------------

[~ajayyadava]: As discussed please make sure you update the documentation for the case where
frequency is not passed by user for the lifecycle retention stage as it doesn't fallback to
old behavior. This should be called out.

> Lifecycle does not allow feed with frequency greater than days(1)
> -----------------------------------------------------------------
>
>                 Key: FALCON-1560
>                 URL: https://issues.apache.org/jira/browse/FALCON-1560
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.8
>            Reporter: Pragya Mittal
>            Assignee: Ajay Yadava
>             Fix For: trunk, 0.8
>
>         Attachments: FALCON-1560-V1.patch, FALCON-1560-V2.patch, FALCON-1560.patch
>
>
> While submitting feed with optional lifecycle frequency it fails with following error
:
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><result>
>   <status>FAILED</status>
>   <message>ua1/Retention can not be more frequent than data availability.
> </message>
>   <requestId>ua1/1309176095@qtp-2030538903-0 - 83c96042-fb26-4b3a-8f47-f855581a5f97
> </requestId>
> </result>
> {noformat}
> Feed definition is :
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1" name="A520c018d-439b98aa"
description="clicks log">
>     <frequency>days(2)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="days(2)"/>
>     <clusters>
>         <cluster name="A520c018d-699dd88a" type="source">
>             <validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
>             <retention limit="days(6)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
>         <location type="stats" path="/projects/falcon/clicksStats"/>
>         <location type="meta" path="/projects/falcon/clicksMetaData"/>
>     </locations>
>     <ACL owner="pragya" group="dataqa" permission="*"/>
>     <schema location="/schema/clicks" provider="protobuf"/>
>     <properties/>
>     <lifecycle>
>         <retention-stage>
>             <queue>default</queue>
>             <priority>HIGH</priority>
>             <properties>
>                 <property name="retention.policy.agebaseddelete.limit" value="days(10)"/>
>             </properties>
>         </retention-stage>
>     </lifecycle>
> </feed>
> {noformat}
> Same behaviour goes for feed having frequency > hours(6)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message