falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "pavan kumar kolamuri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1230) Data based notification Service to notify execution instances when data becomes available
Date Sat, 26 Dec 2015 07:03:49 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071827#comment-15071827
] 

pavan kumar kolamuri commented on FALCON-1230:
----------------------------------------------

After further looking into patch , found forming glob pattern is buggy and there are lot of
corner cases to take care. After having offline discussion with [~sriksun] , we have found
that optimization through forming glob pattern is very little in terms of filesystem calls
, as it happens in client side. And it is very complex to form Glob Pattern from the given
paths and i-notify feature coming soon in hadoop. We have decided to go with normal filesystem
calls for DataAvailability service in Falcon.

> Data based notification Service to notify execution instances when data becomes available
> -----------------------------------------------------------------------------------------
>
>                 Key: FALCON-1230
>                 URL: https://issues.apache.org/jira/browse/FALCON-1230
>             Project: Falcon
>          Issue Type: Sub-task
>    Affects Versions: trunk
>            Reporter: Pallavi Rao
>            Assignee: pavan kumar kolamuri
>         Attachments: FALCON-1230-v1.patch, FALCON-1230-v2.patch, FALCON-1230-v4.patch,
FALCON-1230.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message