hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eli Collins <...@cloudera.com>
Subject Re: S3 FS tests broken?
Date Tue, 14 Aug 2012 17:33:49 GMT
Trevor,
Forgot to ask, since you can reproduce this can you confirm and see
why S3Conf.get is returning null for test.fs.s3.name?

On Mon, Aug 13, 2012 at 6:35 PM, Eli Collins <eli@cloudera.com> wrote:
> Passes for me locally, and the precondition that's failing (passing
> null to Conf#set) from the backtrace looks like the null is coming
> from:
>
>     S3Conf.set(FS_DEFAULT_NAME_DEFAULT, S3Conf.get("test.fs.s3.name"));
>
> which is set in core-site.xml so something strange is going on.
> HADOOP-6296 looks related btw.
>
>
> On Mon, Aug 13, 2012 at 6:04 PM, Trevor <trevor@scurrilous.com> wrote:
>> Anyone know why these tests have started failing? It happens for me locally
>> and it just happened in Jenkins:
>> https://builds.apache.org/job/PreCommit-HADOOP-Build/1288/
>>
>> I don't see any obvious changes recently that would cause it.
>>
>> Tests in error:
>>   testCreateFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>> value must not be null
>>
>> testCreateFileWithNullName(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testCreateExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>
>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testCreateDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>
>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testIsDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testDeleteFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>> value must not be null
>>
>> testDeleteNonExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>
>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testDeleteDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>
>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testModificationTime(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testFileStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>> value must not be null
>>
>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>
>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>> Property value must not be null
>>   testListStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>> value must not be null
>>   testBlockSize(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>   testFsStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWorkingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>   testMkdirs(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>   testListStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>   testOverwrite(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testDeleteNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testDeleteRecursively(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameNonExistentPath(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testInputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>
>> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>> value must not be null
>>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>> value must not be null
>>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>> value must not be null
>>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>> Property value must not be null
>>
>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>> value must not be null
>>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>
>> testListStatusForRoot(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testNoTrailingBackslashOnBucket(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testDirWithDifferentMarkersWorks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testDeleteWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testBlockSize(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRetryOnIoException(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testFsStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWorkingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testMkdirs(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testListStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testOverwrite(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testDeleteNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testDeleteRecursively(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameNonExistentPath(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testInputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>
>> Tests run: 1742, Failures: 0, Errors: 116, Skipped: 5

Mime
View raw message