Return-Path: 
 <common-dev-return-79444-apmail-hadoop-common-dev-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-dev-archive@www.apache.org
Delivered-To: apmail-hadoop-common-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 2AAF0CC9B
	for <apmail-hadoop-common-dev-archive@www.apache.org>;
 Tue, 14 Aug 2012 01:35:57 +0000 (UTC)
Received: (qmail 30746 invoked by uid 500); 14 Aug 2012 01:35:55 -0000
Delivered-To: apmail-hadoop-common-dev-archive@hadoop.apache.org
Received: (qmail 30681 invoked by uid 500); 14 Aug 2012 01:35:55 -0000
Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-dev-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-dev-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-dev@hadoop.apache.org>
List-Id: <common-dev.hadoop.apache.org>
Reply-To: common-dev@hadoop.apache.org
Delivered-To: mailing list common-dev@hadoop.apache.org
Received: (qmail 30672 invoked by uid 99); 14 Aug 2012 01:35:55 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Aug 2012 01:35:55 +0000
X-ASF-Spam-Status: No, hits=-0.7 required=5.0
	tests=RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of eli@cloudera.com designates
 74.125.83.48 as permitted sender)
Received: from [74.125.83.48] (HELO mail-ee0-f48.google.com) (74.125.83.48)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Aug 2012 01:35:47 +0000
Received: by eekd41 with SMTP id d41so1328251eek.35
        for <common-dev@hadoop.apache.org>;
 Mon, 13 Aug 2012 18:35:27 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=google.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:x-gm-message-state;
        bh=ZDDfhPJULKnUHzk+jiE7xpy5tUSeAU/Q+ni4ln8tBx0=;
        b=AAhG1Ea66uEhYT/cnq76y6vfZfKYxD+fX3GmmsYvFY7rvY00f9Xr8MHAIyHSbiZHAw
         TU3Bpw/y7N1OBrkEGeg3C6OxZ/Tun9IYoOySh4wKMio0MMJLqZnQi5vRKdh8+mYrh921
         l8mMekCx80rj4YuEgv5o41q9iWCiLpOt6/3HhvIDRRzMw1dxFNSqm1h3ECXfPmemPmGa
         JgRhnECA+YYC/J7xGZ9LEVLIuJByWs41a9f5bMndVfvjPR7sINQmxFNqqwxvm8ZRzH89
         pTlzGfXsPvv6aaE2mtwyMlSuU6PHxFlo+t1eFJmGR8JiYkr6CX98oQYxy8TuZ2fcbhaU
         HYMA==
MIME-Version: 1.0
Received: by 10.14.180.68 with SMTP id i44mr17007529eem.20.1344908127454; Mon,
 13 Aug 2012 18:35:27 -0700 (PDT)
Received: by 10.14.48.7 with HTTP; Mon, 13 Aug 2012 18:35:27 -0700 (PDT)
In-Reply-To: 
 <CAHwajudnPNZ1Oacm1QaJyyb=6FjHqge-7w=pjihK5bKm9tPdzQ@mail.gmail.com>
References: 
 <CAHwajudnPNZ1Oacm1QaJyyb=6FjHqge-7w=pjihK5bKm9tPdzQ@mail.gmail.com>
Date: Mon, 13 Aug 2012 18:35:27 -0700
Message-ID: 
 <CAPn_vTvNq2BBptVkZ=HV7eh+2BiQfpE1Emd5QvNB2KriR6GykQ@mail.gmail.com>
Subject: Re: S3 FS tests broken?
From: Eli Collins <eli@cloudera.com>
To: common-dev@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
X-Gm-Message-State: 
 ALoCoQmx3T25XuoOSCgkGQKRXz9356d/mhA4Aoo4/+1EH2TeD1X2/bqCBHSx/+FiA6e2Eos0fV1h

Passes for me locally, and the precondition that's failing (passing
null to Conf#set) from the backtrace looks like the null is coming
from:

    S3Conf.set(FS_DEFAULT_NAME_DEFAULT, S3Conf.get("test.fs.s3.name"));

which is set in core-site.xml so something strange is going on.
HADOOP-6296 looks related btw.


On Mon, Aug 13, 2012 at 6:04 PM, Trevor <trevor@scurrilous.com> wrote:
> Anyone know why these tests have started failing? It happens for me locally
> and it just happened in Jenkins:
> https://builds.apache.org/job/PreCommit-HADOOP-Build/1288/
>
> I don't see any obvious changes recently that would cause it.
>
> Tests in error:
>   testCreateFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
> value must not be null
>
> testCreateFileWithNullName(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testCreateExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>
> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testCreateDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>
> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testIsDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testDeleteFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
> value must not be null
>
> testDeleteNonExistingFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>
> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testDeleteDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>
> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testModificationTime(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testFileStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
> value must not be null
>
> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>
> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestS3_LocalFileContextURI):
> Property value must not be null
>   testListStatus(org.apache.hadoop.fs.TestS3_LocalFileContextURI): Property
> value must not be null
>   testBlockSize(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>   testFsStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWorkingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>   testMkdirs(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>   testListStatus(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>   testOverwrite(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testDeleteNonExistentFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testDeleteRecursively(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameNonExistentPath(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testInputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>
> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3.TestInMemoryS3FileSystemContract)
>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
> value must not be null
>   testCreateFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testCreateFileWithNullName(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testCreateExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testCreateFileInNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testCreateDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testIsDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
> value must not be null
>   testDeleteFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testDeleteNonExistingFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testDeleteNonExistingFileInDir(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testDeleteDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testDeleteNonExistingDirectory(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>   testModificationTime(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
> value must not be null
>   testFileStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI):
> Property value must not be null
>
> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI): Property
> value must not be null
>   testListStatus(org.apache.hadoop.fs.TestLocal_S3FileContextURI)
>
> testListStatusForRoot(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testNoTrailingBackslashOnBucket(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testDirWithDifferentMarkersWorks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testDeleteWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameWithNoMarker(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testBlockSize(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRetryOnIoException(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testFsStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWorkingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testMkdirs(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testMkdirsFailsForSubdirectoryOfExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testGetFileStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testListStatusThrowsExceptionForNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testListStatus(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteReadAndDeleteEmptyFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteReadAndDeleteHalfABlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteReadAndDeleteOneBlock(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteReadAndDeleteOneAndAHalfBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteReadAndDeleteTwoBlocks(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testOverwrite(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testWriteInNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testDeleteNonExistentFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testDeleteRecursively(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testDeleteEmptyDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameNonExistentPath(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameFileMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameFileMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameFileAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameFileAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameDirectoryMoveToNonExistentDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameDirectoryMoveToExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameDirectoryAsExistingFile(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testRenameDirectoryAsExistingDirectory(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testInputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> testOutputStreamClosedTwice(org.apache.hadoop.fs.s3native.TestInMemoryNativeS3FileSystemContract)
>
> Tests run: 1742, Failures: 0, Errors: 116, Skipped: 5