falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-161) Feed evictor evicts instances not eligible when pattern has dash
Date Thu, 31 Oct 2013 17:57:17 GMT

    [ https://issues.apache.org/jira/browse/FALCON-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13810492#comment-13810492

Venkatesh Seetharam commented on FALCON-161:

Hi Shaik, glad to see you active. :-)

bq. Is this issue common across non Hcat based feeds?
Nope. Its only applicable for feeds with table storage. The problem was I reused existing
code which uses file glob to look at candidates for eviction but that does not work for partitions
since Hive filter does a lexical comparison.

This is not related to the scenarios you have described above.

> Feed evictor evicts instances not eligible when pattern has dash
> ----------------------------------------------------------------
>                 Key: FALCON-161
>                 URL: https://issues.apache.org/jira/browse/FALCON-161
>             Project: Falcon
>          Issue Type: Sub-task
>    Affects Versions: 0.3
>            Reporter: Venkatesh Seetharam
>            Assignee: Venkatesh Seetharam
>         Attachments: FALCON_161.patch
> I encountered this bug accidentally when testing replication. The desired instance for
replication was always evicted when it was not eligible and replication fails all the time
in late data saying the partition does not exist. After looking at this for some time, figured
out that a partition containing "-" in the pattern did not work since I had reused much of
existing code that ignores it in FileSystem storage.
> {code} ${YEAR}-${MONTH}-${DAY} {code} 

This message was sent by Atlassian JIRA

View raw message