falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-301) Falcon allows multiple feed submission on a single path in hdfs
Date Thu, 06 Mar 2014 14:34:43 GMT

    [ https://issues.apache.org/jira/browse/FALCON-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13922563#comment-13922563
] 

Shaik Idris Ali commented on FALCON-301:
----------------------------------------

{quote}
2. What if there is a feed which is a complete subset of another feed. We ought to disallow
that as well. This doesn't seem to address that.
{quote}

This is a valid use-case, and even if we solve backward compatibility will be a problem.
Ex: consider a feed replication with multiple source and a single target:
So user define a feed till the partition expression (before colo)
ex:/path/xxx/yyy/{colo}
/path/xxx/yyy/_SUCCESS

Now, after replication in source clusters if users need to gate on availability of data from
each colo, they may choose to define multiple feeds till the colo
i.e /path/xxx/yyy/{colo}/_SUCCESS

With HCat it can be achieved but with FileSystem storage it will be a problem.


> Falcon allows multiple feed submission on a single path in hdfs
> ---------------------------------------------------------------
>
>                 Key: FALCON-301
>                 URL: https://issues.apache.org/jira/browse/FALCON-301
>             Project: Falcon
>          Issue Type: Bug
>          Components: client, feed
>    Affects Versions: 0.5
>            Reporter: Deepak Marathe
>            Assignee: Deepak Marathe
>            Priority: Minor
>             Fix For: 0.5
>
>         Attachments: diff.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message