falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-301) Falcon allows multiple feed submission on a single path in hdfs
Date Thu, 06 Mar 2014 14:34:43 GMT

    [ https://issues.apache.org/jira/browse/FALCON-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13922563#comment-13922563

Shaik Idris Ali commented on FALCON-301:

2. What if there is a feed which is a complete subset of another feed. We ought to disallow
that as well. This doesn't seem to address that.

This is a valid use-case, and even if we solve backward compatibility will be a problem.
Ex: consider a feed replication with multiple source and a single target:
So user define a feed till the partition expression (before colo)

Now, after replication in source clusters if users need to gate on availability of data from
each colo, they may choose to define multiple feeds till the colo
i.e /path/xxx/yyy/{colo}/_SUCCESS

With HCat it can be achieved but with FileSystem storage it will be a problem.

> Falcon allows multiple feed submission on a single path in hdfs
> ---------------------------------------------------------------
>                 Key: FALCON-301
>                 URL: https://issues.apache.org/jira/browse/FALCON-301
>             Project: Falcon
>          Issue Type: Bug
>          Components: client, feed
>    Affects Versions: 0.5
>            Reporter: Deepak Marathe
>            Assignee: Deepak Marathe
>            Priority: Minor
>             Fix For: 0.5
>         Attachments: diff.patch

This message was sent by Atlassian JIRA

View raw message