hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16586) ITestS3GuardFsck, others fails when nun using a local metastore
Date Thu, 19 Sep 2019 10:47:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933267#comment-16933267
] 

Steve Loughran commented on HADOOP-16586:
-----------------------------------------

* ITestS3GuardFsck looks like an extra assume() is needed in test setup
* ITestPartialRenamesDeletes errors look new. Can you stick up the stack traces?
* same for ITestS3GuardToolLocal

> ITestS3GuardFsck, others fails when nun using a local metastore
> ---------------------------------------------------------------
>
>                 Key: HADOOP-16586
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16586
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/s3
>            Reporter: Siddharth Seth
>            Priority: Major
>
> Most of these tests fail if running against a local metastore with a ClassCastException.
> Not sure if these tests are intended to work with dynamo only. The fix (either ignore
in case of other metastores or fix the test) would depend on the original intent.
> {code}
> -------------------------------------------------------------------------------
> Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck
> -------------------------------------------------------------------------------
> Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s <<<
FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck
> testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time
elapsed: 3.237 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190)
> testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
1.827 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214)
> testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
2.819 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311)
> testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed: 2.832
s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373)
> testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
2.752 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238)
> testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
4.103 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346)
> testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
3.017 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113)
> testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
2.821 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136)
> testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed: 4.493 s
 <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403)
> testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)  Time elapsed:
2.782 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentIsAFile(ITestS3GuardFsck.java:163)
> testTombstonedInMsNotDeletedInS3(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) 
Time elapsed: 3.008 s  <<< ERROR!
> java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot
be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore
>   at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testTombstonedInMsNotDeletedInS3(ITestS3GuardFsck.java:432)
> {code}
> ITestPartialRenamesDeletes
> {code}
> [ERROR]   ITestPartialRenamesDeletes.testRenameDirFailsInDelete:510 » FileNotFound Path
...
> [ERROR]   ITestPartialRenamesDeletes.testRenameDirFailsInDelete:510 » FileNotFound Path
...
> [ERROR]   ITestPartialRenamesDeletes.testRenameParentPathNotWriteable:411->AbstractFSContractTestBase.assertIsFile:316
» FileNotFound
> [ERROR]   ITestPartialRenamesDeletes.testRenameParentPathNotWriteable:411->AbstractFSContractTestBase.assertIsFile:316
» FileNotFound
> {code}
> ITestS3GuardToolLocal
> {code}
> [ERROR] Errors:
> [ERROR]   ITestS3GuardToolLocal.testInitNegativeRead:176->AbstractS3GuardToolTestBase.runToFailure:150->AbstractS3GuardToolTestBase.run:137
» IllegalArgument
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message