falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Satish Mittal (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (FALCON-284) Hcatalog based feed retention doesn't work when partition filter spans across multiple partition keys
Date Tue, 11 Feb 2014 09:41:19 GMT

     [ https://issues.apache.org/jira/browse/FALCON-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Satish Mittal reassigned FALCON-284:
------------------------------------

    Assignee: Satish Mittal

> Hcatalog based feed retention doesn't work when partition filter spans across multiple
partition keys
> -----------------------------------------------------------------------------------------------------
>
>                 Key: FALCON-284
>                 URL: https://issues.apache.org/jira/browse/FALCON-284
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.5
>            Reporter: Satish Mittal
>            Assignee: Satish Mittal
>
> When an HCatalog based feed is scheduled in falcon, retention only looks at the first
partition key that satisfies either of date pattern: yyyy | MM | dd | HH | mm. As a result,
it calculates a partition filter that contains only one of these patterns. However if HCatalog
table is defined in such a way that date spans across multiple partition keys (year/month/day/hour/minute),
then feed retention doesn't delete any partitions that are granular than first level (year).



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message