sentry-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arjun Mishra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SENTRY-2183) Increase default sentry-hdfs rpc timeout to 20 mins
Date Thu, 15 Mar 2018 18:15:00 GMT

    [ https://issues.apache.org/jira/browse/SENTRY-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400886#comment-16400886
] 

Arjun Mishra commented on SENTRY-2183:
--------------------------------------

Test passes locally. Will re-submit the same patch
{noformat}
$ mvn -f sentry-tests/sentry-tests-hive/pom.xml test -Dtest=TestHmsNotificationProcessingWithOutSyncOnDrop

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.sentry.tests.e2e.dbprovider.TestHmsNotificationProcessingWithOutSyncOnDrop
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.931 s - in org.apache.sentry.tests.e2e.dbprovider.TestHmsNotificationProcessingWithOutSyncOnDrop
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 47.291 s
[INFO] Finished at: 2018-03-15T23:10:22+05:30
[INFO] Final Memory: 85M/836M
[INFO] ------------------------------------------------------------------------
{noformat}

> Increase default sentry-hdfs rpc timeout to 20 mins
> ---------------------------------------------------
>
>                 Key: SENTRY-2183
>                 URL: https://issues.apache.org/jira/browse/SENTRY-2183
>             Project: Sentry
>          Issue Type: Improvement
>          Components: Sentry
>    Affects Versions: 2.1.0
>            Reporter: Arjun Mishra
>            Assignee: Arjun Mishra
>            Priority: Major
>         Attachments: SENTRY-2183.01.patch
>
>
> Full HMS Snapshots for large amounts of data (millions of databases, or tables or partitions
etc) take a lot more time than the current default of 3.3mins. Also ideally since a full HMS
snapshot should only occur once it is best to increase the default to 20mins. This highly
reduce the chance of failure while sending a full snapshot which could be critical
> Set sentry.hdfs.service.client.server.rpc-connection-timeout = 1200000



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message