falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-284) Hcatalog based feed retention doesn't work when partition filter spans across multiple partition keys
Date Wed, 05 Mar 2014 19:48:44 GMT

    [ https://issues.apache.org/jira/browse/FALCON-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921300#comment-13921300
] 

Venkatesh Seetharam commented on FALCON-284:
--------------------------------------------

Comments on review board.

> Hcatalog based feed retention doesn't work when partition filter spans across multiple
partition keys
> -----------------------------------------------------------------------------------------------------
>
>                 Key: FALCON-284
>                 URL: https://issues.apache.org/jira/browse/FALCON-284
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.5
>            Reporter: Satish Mittal
>            Assignee: Satish Mittal
>         Attachments: FALCON-284.patch.txt
>
>
> When an HCatalog based feed is scheduled in falcon, retention only looks at the first
partition key that satisfies either of date pattern: yyyy | MM | dd | HH | mm. As a result,
it calculates a partition filter that contains only one of these patterns. However if HCatalog
table is defined in such a way that date spans across multiple partition keys (year/month/day/hour/minute),
then feed retention doesn't delete any partitions that are granular than first level (year).



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message