falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Samarth Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-306) Feed late replication is not working
Date Fri, 28 Mar 2014 06:01:23 GMT

    [ https://issues.apache.org/jira/browse/FALCON-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950420#comment-13950420
] 

Samarth Gupta commented on FALCON-306:
--------------------------------------

[~raghavgautam]  how long did u wait once the new data was put into source folder ?  default
value seems to be 3 hours before late data service check for new data. Below are the default
props and values. You can override them in runtime.properties to test . 

{code}
 lateProcess.setDelay(new Frequency(RuntimeProperties.get().getProperty("feed.late.frequency",
"hours(3)")));
           lateProcess.setPolicy(
                   PolicyType.fromValue(RuntimeProperties.get().getProperty("feed.late.policy",
"exp-backoff")));
11:27 AM
           if (!RuntimeProperties.get().getProperty("feed.late.allowed", "true").equalsIgnoreCase("true"))
{
{code}

> Feed late replication is not working
> ------------------------------------
>
>                 Key: FALCON-306
>                 URL: https://issues.apache.org/jira/browse/FALCON-306
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Raghav Kumar Gautam
>              Labels: falcon-regression
>
> *STR*
> - Source clusters have following folders:
>   at colo=ua3, partition=UK/${cluster.colo} folder=input-data/2014/02/05/22/08/UK/ua3
>   at colo=ua2, partition=US/${cluster.colo} folder=input-data/2014/02/05/22/08/US/ua2
> - Target cluster
>   at colo=ua1: folder=input-data/2014/02/05/22/08/
> - Upload some data in source folders
> - Replication goes through
> - Upload some more data in source folders
> - Late replication does not happen
> *Test*
> PrismFeedLateReplicationTest#multipleSourceOneTarget_pastData
> PrismFeedLateReplicationTest#multipleSourceOneTarget_futureData



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message