falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1375) Adding latePolicy element in feed definition
Date Thu, 06 Aug 2015 09:04:04 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659707#comment-14659707

Pallavi Rao commented on FALCON-1375:

These properties were introduced as part of FALCON-1024. 

I agree these should be more of entity level properties coz., each feed has a different frequency.
The runtime properties can be treated as defaults if none is specified in the entity.

> Adding latePolicy element in feed definition
> --------------------------------------------
>                 Key: FALCON-1375
>                 URL: https://issues.apache.org/jira/browse/FALCON-1375
>             Project: Falcon
>          Issue Type: Improvement
>          Components: feed
>    Affects Versions: trunk
>            Reporter: Pragya Mittal
> As of now feed replication honours late policy but there is no way we can overwrite this
property via feed definition.feed only exposes <late-arrival cut-off="days(100000)"/>

> The late policy is defined in runtime.properties :
> {code}
> *.feed.late.allowed=true
> *.feed.late.frequency=hours(3)
> *.feed.late.policy=exp-backoff
> {code}
> If user wants to overwrite these properties(changing late policy or frequency) , they
have to be explicitly changed in runtime.properties. Setting these via feed definition would
reduce such overheads.

This message was sent by Atlassian JIRA

View raw message