falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pragya Mittal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1807) Late Rerun is not working in distributed mode
Date Tue, 02 Feb 2016 09:17:39 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127945#comment-15127945
] 

Pragya Mittal commented on FALCON-1807:
---------------------------------------

Process definition :
{noformat}
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<process name="ProcessLateRerunTest-agregator" xmlns="uri:falcon:process:0.1">
    <clusters>
        <cluster name="ProcessLateRerunTest-corp">
            <validity start="2016-02-02T09:13Z" end="2016-02-02T09:43Z"/>
        </cluster>
    </clusters>
    <parallel>2</parallel>
    <order>FIFO</order>
    <frequency>minutes(5)</frequency>
    <timezone>UTC</timezone>
    <inputs>
        <input name="inputData" feed="ProcessLateRerunTest-raaw-logs" start="now(0,-1)"
end="now(0,0)"/>
    </inputs>
    <outputs>
        <output name="outputData" feed="ProcessLateRerunTest-agregated" instance="now(0,0)"/>
    </outputs>
    <properties>
        <property name="queueName" value="default"/>
    </properties>
    <workflow path="/tmp/falcon-regression/ProcessLateRerunTest/aggregator"/>
    <retry policy="periodic" delay="minutes(10)" attempts="3"/>
    <late-process policy="periodic" delay="minutes(4)">
        <late-input input="inputData" workflow-path="/tmp/falcon-regression/ProcessLateRerunTest/aggregator"/>
    </late-process>
    <ACL owner="pragya" group="dataqa" permission="*"/>
</process>
{noformat}

> Late Rerun is not working in distributed mode
> ---------------------------------------------
>
>                 Key: FALCON-1807
>                 URL: https://issues.apache.org/jira/browse/FALCON-1807
>             Project: Falcon
>          Issue Type: Bug
>          Components: rerun
>    Affects Versions: 0.9
>            Reporter: Pragya Mittal
>            Assignee: Pallavi Rao
>            Priority: Blocker
>
> Ideally late rerun, runs the instance if and when the data becomes available in the late
rerun zone. This is not happening currently.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message