sentry-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arjun Mishra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SENTRY-2040) When getting Snapshots from HMS we need more logging around cases when a snapshot is not being received
Date Wed, 15 Nov 2017 15:50:02 GMT

    [ https://issues.apache.org/jira/browse/SENTRY-2040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253665#comment-16253665
] 

Arjun Mishra commented on SENTRY-2040:
--------------------------------------

Not sure why this is failing. Below are the test results
{noformat}
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.sentry.provider.db.tools.TestSentrySchemaTool
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.433 s - in org.apache.sentry.provider.db.tools.TestSentrySchemaTool
[INFO] Running org.apache.sentry.provider.db.tools.TestSentryShellHive
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.68 s - in org.apache.sentry.provider.db.tools.TestSentryShellHive
[INFO] Running org.apache.sentry.provider.db.log.appender.TestRollingFileWithoutDeleteAppender
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.161 s - in org.apache.sentry.provider.db.log.appender.TestRollingFileWithoutDeleteAppender
[INFO] Running org.apache.sentry.provider.db.log.util.TestCommandUtil
[INFO] Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.101 s - in org.apache.sentry.provider.db.log.util.TestCommandUtil
[INFO] Running org.apache.sentry.provider.db.log.entity.TestJsonLogEntityFactory
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.451 s - in org.apache.sentry.provider.db.log.entity.TestJsonLogEntityFactory
[INFO] Running org.apache.sentry.provider.db.log.entity.TestGMAuditMetadataLogEntity
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.258 s - in org.apache.sentry.provider.db.log.entity.TestGMAuditMetadataLogEntity
[INFO] Running org.apache.sentry.provider.db.log.entity.TestDbAuditMetadataLogEntity
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.261 s - in org.apache.sentry.provider.db.log.entity.TestDbAuditMetadataLogEntity
[INFO] Running org.apache.sentry.provider.db.log.entity.TestJsonLogEntityFactoryGM
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.515 s - in org.apache.sentry.provider.db.log.entity.TestJsonLogEntityFactoryGM
[INFO] Running org.apache.sentry.provider.db.generic.tools.TestSentryShellSqoop
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.947 s - in org.apache.sentry.provider.db.generic.tools.TestSentryShellSqoop
[INFO] Running org.apache.sentry.provider.db.generic.tools.TestSentryShellSolr
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.513 s - in org.apache.sentry.provider.db.generic.tools.TestSentryShellSolr
[INFO] Running org.apache.sentry.provider.db.generic.tools.TestSentryShellKafka
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.064 s - in org.apache.sentry.provider.db.generic.tools.TestSentryShellKafka
[INFO] Running org.apache.sentry.provider.db.generic.tools.TestSentryConfigToolSolr
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.22 s - in org.apache.sentry.provider.db.generic.tools.TestSentryConfigToolSolr
[INFO] Running org.apache.sentry.provider.db.generic.TestSentryGenericProviderBackend
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.374 s - in org.apache.sentry.provider.db.generic.TestSentryGenericProviderBackend
[INFO] Running org.apache.sentry.provider.db.generic.service.persistent.TestSentryGMPrivilege
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 s - in org.apache.sentry.provider.db.generic.service.persistent.TestSentryGMPrivilege
[INFO] Running org.apache.sentry.provider.db.generic.service.persistent.TestPrivilegeOperatePersistence
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.486 s - in org.apache.sentry.provider.db.generic.service.persistent.TestPrivilegeOperatePersistence
[INFO] Running org.apache.sentry.provider.db.generic.service.persistent.TestSentryRole
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.268 s - in org.apache.sentry.provider.db.generic.service.persistent.TestSentryRole
[INFO] Running org.apache.sentry.provider.db.generic.service.persistent.TestDelegateSentryStore
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5 s - in org.apache.sentry.provider.db.generic.service.persistent.TestDelegateSentryStore
[INFO] Running org.apache.sentry.provider.db.generic.service.thrift.TestAuditLogForSentryGenericService
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.067 s - in org.apache.sentry.provider.db.generic.service.thrift.TestAuditLogForSentryGenericService
[INFO] Running org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericServiceClient
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.228 s - in org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericServiceClient
[INFO] Running org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericPolicyProcessor
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.909 s - in org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericPolicyProcessor
[INFO] Running org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericServiceIntegration
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 40.866 s - in org.apache.sentry.provider.db.generic.service.thrift.TestSentryGenericServiceIntegration
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestHMSFollowerSentryStoreIntegration
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.079 s - in org.apache.sentry.provider.db.service.persistent.TestHMSFollowerSentryStoreIntegration
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestSentryStoreToAuthorizable
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 s - in org.apache.sentry.provider.db.service.persistent.TestSentryStoreToAuthorizable
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestSentryStoreImportExport
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.046 s - in org.apache.sentry.provider.db.service.persistent.TestSentryStoreImportExport
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestSentryVersion
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.906 s - in org.apache.sentry.provider.db.service.persistent.TestSentryVersion
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestSentryStore
[INFO] Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 130.101 s - in org.apache.sentry.provider.db.service.persistent.TestSentryStore
[INFO] Running org.apache.sentry.provider.db.service.persistent.TestSentryPrivilege
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.379 s - in org.apache.sentry.provider.db.service.persistent.TestSentryPrivilege
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceFailureCase
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.813 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceFailureCase
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServerLogLevel
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.584 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServerLogLevel
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryPolicyStoreProcessor
[INFO] Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 s - in org.apache.sentry.provider.db.service.thrift.TestSentryPolicyStoreProcessor
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithoutSecurity
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.139 s - in org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithoutSecurity
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceForPoolWithKerberos
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.407 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceForPoolWithKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServerWithoutKerberos
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.831 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServerWithoutKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceImportExport
[INFO] Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.392 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceImportExport
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestNotificationHandlerInvoker
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.353 s - in org.apache.sentry.provider.db.service.thrift.TestNotificationHandlerInvoker
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServerForPoolWithoutKerberos
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.895 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServerForPoolWithoutKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithSSL
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.638 s - in org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithSSL
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceIntegration
[INFO] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.003 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceIntegration
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryPolicyServiceClient
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.283 s - in org.apache.sentry.provider.db.service.thrift.TestSentryPolicyServiceClient
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithKerberos
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.907 s - in org.apache.sentry.provider.db.service.thrift.TestSentryWebServerWithKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceWithInvalidMsgSize
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.154 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceWithInvalidMsgSize
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceClientPool
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.564 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceClientPool
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServerPubSub
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.531 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServerPubSub
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestConnectionWithTicketTimeout
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.024 s - in org.apache.sentry.provider.db.service.thrift.TestConnectionWithTicketTimeout
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceWithKerberos
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.496 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceWithKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestAuthorizingDDLAuditLogWithKerberos
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.811 s - in org.apache.sentry.provider.db.service.thrift.TestAuthorizingDDLAuditLogWithKerberos
[INFO] Running org.apache.sentry.provider.db.service.thrift.TestSentryServiceMetrics
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.916 s - in org.apache.sentry.provider.db.service.thrift.TestSentryServiceMetrics
[INFO] Running org.apache.sentry.provider.db.service.model.TestMSentryUtil
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.403 s - in org.apache.sentry.provider.db.service.model.TestMSentryUtil
[INFO] Running org.apache.sentry.service.thrift.TestLeaderStatusMonitor
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.468 s - in org.apache.sentry.service.thrift.TestLeaderStatusMonitor
[INFO] Running org.apache.sentry.service.thrift.TestSentryHMSClient
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.002 s - in org.apache.sentry.service.thrift.TestSentryHMSClient
[INFO] Running org.apache.sentry.service.thrift.TestHiveNotificationFetcher
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.698 s - in org.apache.sentry.service.thrift.TestHiveNotificationFetcher
[INFO] Running org.apache.sentry.service.thrift.TestHMSFollower
[WARNING] Tests run: 18, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 1.595 s - in org.apache.sentry.service.thrift.TestHMSFollower
[INFO] Running org.apache.sentry.service.thrift.TestSentryStateBank
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.148 s - in org.apache.sentry.service.thrift.TestSentryStateBank
[INFO] Running org.apache.sentry.service.thrift.TestFullUpdateInitializer
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.671 s - in org.apache.sentry.service.thrift.TestFullUpdateInitializer
[INFO] Running org.apache.sentry.service.thrift.TestNotificationProcessor
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.29 s - in org.apache.sentry.service.thrift.TestNotificationProcessor
[INFO] Running org.apache.sentry.service.thrift.TestFullUpdateModifier
[INFO] Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.621 s - in org.apache.sentry.service.thrift.TestFullUpdateModifier
[INFO] Running org.apache.sentry.service.thrift.TestCounterWait
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.164 s - in org.apache.sentry.service.thrift.TestCounterWait
[INFO]
[INFO] Results:
[INFO]
[WARNING] Tests run: 363, Failures: 0, Errors: 0, Skipped: 2
{noformat}

> When getting Snapshots from HMS we need more logging around cases when a snapshot is
not being received
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SENTRY-2040
>                 URL: https://issues.apache.org/jira/browse/SENTRY-2040
>             Project: Sentry
>          Issue Type: Bug
>          Components: Sentry
>    Affects Versions: 2.0.0
>            Reporter: Arjun Mishra
>            Assignee: Arjun Mishra
>              Labels: bite-sized, mewbi
>             Fix For: 2.0.0
>
>         Attachments: SENTRY-2040.01.patch, SENTRY-2040.02.patch
>
>
> Currently we only seem to log when all conditions that lead to getting a snapshot are
validated, and eventually a full snapshot is received. However, if for some reason a particular
condition was invalid we don't log as to why. This leaves no room for knowing definitely what
might have been the reason as to why a snapshot was not received from HMS. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message