falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FALCON-1676) When a paritition is specified in input feed, Falcon should only wait for data availability in a partition
Date Mon, 21 Dec 2015 05:26:46 GMT
Pallavi Rao created FALCON-1676:
-----------------------------------

             Summary: When a paritition is specified in input feed, Falcon should only wait
for data availability in a partition
                 Key: FALCON-1676
                 URL: https://issues.apache.org/jira/browse/FALCON-1676
             Project: Falcon
          Issue Type: Bug
            Reporter: Pallavi Rao


When a process uses a feed with partition as its input, Falcon waits for data to be available
in all partitions (parent dir), rather than just wait for data availability in that particular
partition.

Example process input:
{code}
<inputs>
        <input name="ConversionEnhance" feed="FETL-ConversionEnhance" start="now(0,-30)"
end="now(0,-30)" partition="*/{MATCH}"/>
{code}

If the consumer doesn't want to wait for all the data to available and is bothered about data
only in that partition, currently, user will be forced to create a feed per partition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message