falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-630) late data rerun for process broken in trunk
Date Fri, 22 Aug 2014 11:09:11 GMT

     [ https://issues.apache.org/jira/browse/FALCON-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shwetha G S updated FALCON-630:
-------------------------------

    Attachment: FALCON-630.patch

This is just main code changes. I have introduced new variable which contains input names
which is used for late data detection. I have also renamed {{WorkflowExecutionArgs.FEED_NAMES}}
to OUTPUT_FEED_NAMES and {{WorkflowExecutionArgs.FEED_PATHS}} to OUTPUT_FEED_PATHS. Still
need to fix the tests.

[~svenkat], can you please check if the main changes are ok

> late data rerun for process broken in trunk 
> --------------------------------------------
>
>                 Key: FALCON-630
>                 URL: https://issues.apache.org/jira/browse/FALCON-630
>             Project: Falcon
>          Issue Type: Bug
>          Components: rerun
>    Affects Versions: 0.5
>            Reporter: Samarth Gupta
>            Assignee: Shwetha G S
>            Priority: Blocker
>             Fix For: 0.4
>
>         Attachments: FALCON-630.patch
>
>
> late data rerun for process is not working . it seems like in pre processing record size
is storing data by Feed name and not by input name , due to which late data is never detected.

> {code}
>                     -falconInputFeeds
>                     FETL2-RRLog#FETL-RTBS-PRLog#FETL-RTBS-NPRLog
> {code}
> above even though param in tasktracker logs says InputFeeds , they are actually feed
name. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message