falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajay Yadava (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1560) Lifecycle does not allow feed with frequency greater than days(1)
Date Thu, 29 Oct 2015 04:44:27 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979803#comment-14979803
] 

Ajay Yadava commented on FALCON-1560:
-------------------------------------

I had an offline discussion with [~sowmyaramesh] and addressed all review comments. I have
updated the discussion on the reviewboard. I need to commit this to unblock [~pragya.mittal]
for testing, so I am going ahead and committing this. 

> Lifecycle does not allow feed with frequency greater than days(1)
> -----------------------------------------------------------------
>
>                 Key: FALCON-1560
>                 URL: https://issues.apache.org/jira/browse/FALCON-1560
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.8
>            Reporter: Pragya Mittal
>            Assignee: Ajay Yadava
>             Fix For: 0.8
>
>         Attachments: FALCON-1560-V1.patch, FALCON-1560-V2.patch, FALCON-1560.patch
>
>
> While submitting feed with optional lifecycle frequency it fails with following error
:
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><result>
>   <status>FAILED</status>
>   <message>ua1/Retention can not be more frequent than data availability.
> </message>
>   <requestId>ua1/1309176095@qtp-2030538903-0 - 83c96042-fb26-4b3a-8f47-f855581a5f97
> </requestId>
> </result>
> {noformat}
> Feed definition is :
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?><feed xmlns="uri:falcon:feed:0.1" name="A520c018d-439b98aa"
description="clicks log">
>     <frequency>days(2)</frequency>
>     <timezone>UTC</timezone>
>     <late-arrival cut-off="days(2)"/>
>     <clusters>
>         <cluster name="A520c018d-699dd88a" type="source">
>             <validity start="2012-01-30T00:00Z" end="2099-03-31T23:59Z"/>
>             <retention limit="days(6)" action="delete"/>
>         </cluster>
>     </clusters>
>     <locations>
>         <location type="data" path="/tmp/falcon-regression/LifecycleHourlyTest/testFolders/${YEAR}/${MONTH}/${DAY}"/>
>         <location type="stats" path="/projects/falcon/clicksStats"/>
>         <location type="meta" path="/projects/falcon/clicksMetaData"/>
>     </locations>
>     <ACL owner="pragya" group="dataqa" permission="*"/>
>     <schema location="/schema/clicks" provider="protobuf"/>
>     <properties/>
>     <lifecycle>
>         <retention-stage>
>             <queue>default</queue>
>             <priority>HIGH</priority>
>             <properties>
>                 <property name="retention.policy.agebaseddelete.limit" value="days(10)"/>
>             </properties>
>         </retention-stage>
>     </lifecycle>
> </feed>
> {noformat}
> Same behaviour goes for feed having frequency > hours(6)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message