sentry-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arjun Mishra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SENTRY-2290) Avoid storing the path information for partitions in default location
Date Mon, 01 Oct 2018 04:09:00 GMT

    [ https://issues.apache.org/jira/browse/SENTRY-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633599#comment-16633599
] 

Arjun Mishra commented on SENTRY-2290:
--------------------------------------

[~kkalyan] Can you change the resolution as this is not fixed

> Avoid storing the path information for partitions in default location
> ---------------------------------------------------------------------
>
>                 Key: SENTRY-2290
>                 URL: https://issues.apache.org/jira/browse/SENTRY-2290
>             Project: Sentry
>          Issue Type: Sub-task
>          Components: Sentry
>    Affects Versions: 2.1.0
>            Reporter: kalyan kumar kalvagadda
>            Assignee: kalyan kumar kalvagadda
>            Priority: Major
>             Fix For: 2.1.0
>
>
> Sentry can ignore the partitions entries which are located in default location as they
share the same permissions as the table. This will reduce the snapshot size decreasing the
time to persist the snapshot and also time to send the full update to Namenode. This is important
as the partition information has lion’s share in a HMS Full snapshot. Same approach can
be taken for tables as well but the issue is that we need to re-construct the location
based on the database and table names while constructing the ACL for the table location. This
may increase the CPU overhead. With partitions we are safe to ignore the partitions with default
location as sentry doesn't support permissions on partitions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message