falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-1676) When a paritition is specified in input feed, Falcon should only wait for data availability in that partition
Date Mon, 21 Dec 2015 05:29:46 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pallavi Rao updated FALCON-1676:
--------------------------------
    Summary: When a paritition is specified in input feed, Falcon should only wait for data
availability in that partition  (was: When a paritition is specified in input feed, Falcon
should only wait for data availability in a partition)

> When a paritition is specified in input feed, Falcon should only wait for data availability
in that partition
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: FALCON-1676
>                 URL: https://issues.apache.org/jira/browse/FALCON-1676
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Pallavi Rao
>
> When a process uses a feed with partition as its input, Falcon waits for data to be available
in all partitions (parent dir), rather than just wait for data availability in that particular
partition.
> Example process input:
> {code}
> <inputs>
>         <input name="ConversionEnhance" feed="FETL-ConversionEnhance" start="now(0,-30)"
end="now(0,-30)" partition="*/{MATCH}"/>
> {code}
> If the consumer doesn't want to wait for all the data to available and is bothered about
data only in that partition, currently, user will be forced to create a feed per partition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message