hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alejandro Abdelnur <t...@cloudera.com>
Subject Re: S3 FS tests broken?
Date Tue, 14 Aug 2012 18:37:30 GMT
This is me,

https://issues.apache.org/jira/browse/HADOOP-8699

On it

Thx

On Tue, Aug 14, 2012 at 10:33 AM, Eli Collins <eli@cloudera.com> wrote:
> Trevor,
> Forgot to ask, since you can reproduce this can you confirm and see
> why S3Conf.get is returning null for test.fs.s3.name?
>
> On Mon, Aug 13, 2012 at 6:35 PM, Eli Collins <eli@cloudera.com> wrote:
>> Passes for me locally, and the precondition that's failing (passing
>> null to Conf#set) from the backtrace looks like the null is coming
>> from:
>>
>>     S3Conf.set(FS_DEFAULT_NAME_DEFAULT, S3Conf.get("test.fs.s3.name"));
>>
>> which is set in core-site.xml so something strange is going on.
>> HADOOP-6296 looks related btw.
>>
>>
>> On Mon, Aug 13, 2012 at 6:04 PM, Trevor <trevor@scurrilous.com> wrote:
>>> Anyone know why these tests have started failing? It happens for me locally
>>> and it just happened in Jenkins:
>>> https://builds.apache.org/job/PreCommit-HADOOP-Build/1288/
>>>
>>> I don't see any obvious changes recently that would cause it.
>>>
>>> Tests in error:
>>>   testCreateFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testCreateFileWithNullName(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testCreateExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testCreateDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testIsDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testDeleteFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testDeleteNonExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testDeleteDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testModificationTime(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testFileStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
>>> Property value must not be null
>>>   testListStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
>>> value must not be null
>>>   testBlockSize(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testFsStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWorkingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testMkdirs(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testListStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testOverwrite(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testDeleteNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testDeleteRecursively(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameNonExistentPath(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testInputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>
>>> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>>>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>>> value must not be null
>>>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>>> value must not be null
>>>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>>> value must not be null
>>>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
>>> Property value must not be null
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
>>> value must not be null
>>>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>>>
>>> testListStatusForRoot(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testNoTrailingBackslashOnBucket(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testDirWithDifferentMarkersWorks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testDeleteWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testBlockSize(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRetryOnIoException(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testFsStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWorkingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testMkdirs(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testListStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testOverwrite(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testDeleteNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testDeleteRecursively(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameNonExistentPath(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testInputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>>>
>>> Tests run: 1742, Failures: 0, Errors: 116, Skipped: 5



-- 
Alejandro

Mime
View raw message