Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 61717 invoked from network); 4 Mar 2009 23:07:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 4 Mar 2009 23:07:59 -0000 Received: (qmail 19444 invoked by uid 500); 4 Mar 2009 23:07:52 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 19403 invoked by uid 500); 4 Mar 2009 23:07:51 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 19392 invoked by uid 99); 4 Mar 2009 23:07:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Mar 2009 15:07:51 -0800 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sd.codewarrior@gmail.com designates 74.125.46.30 as permitted sender) Received: from [74.125.46.30] (HELO yw-out-2324.google.com) (74.125.46.30) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Mar 2009 23:07:45 +0000 Received: by yw-out-2324.google.com with SMTP id 2so1947726ywt.29 for ; Wed, 04 Mar 2009 15:07:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=intb3bKOVdrHIAgCAAniNr1TAOCQcrbSkzJ1kzRWTZ4=; b=ATOKTeXSkuX1ejk7aFufWep+2KILhe1DSMY7u7L94uRd3IMNdMVZHYUmIL+JhHdvYu UOuk117GXrEUJSIY5fUxCgFgTg5maZB5fpWA30vvjEsC9dr6Kof5K+M7e7LcEn0lAZL+ ltzr2b4BgXYOYMv8xZu4nmamMcZu/siT5ohTo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=t6HK/kbi08VsSISiLm8JMj+QHTqswsVNu9/Hjx/oYoMt8ANV899mGR8oIw11bTmJA3 lTyp7tRrr6rYQ1c05NcG5pg15M4SlbRu5PZDxhzDvUtf8BamcbUI1kxZPrL4RYJx0UFM pTQ5GBa28ZR5UhZpmwJ1ce1aUfilq2axAdfjc= MIME-Version: 1.0 Received: by 10.220.96.130 with SMTP id h2mr192618vcn.21.1236208044608; Wed, 04 Mar 2009 15:07:24 -0800 (PST) In-Reply-To: <4f10e2890903041418q325f0dc5p6c8bf2f454272b1c@mail.gmail.com> References: <4f10e2890903041418q325f0dc5p6c8bf2f454272b1c@mail.gmail.com> Date: Wed, 4 Mar 2009 18:07:24 -0500 Message-ID: <4f10e2890903041507s371ef550nbd9114b3732470a@mail.gmail.com> Subject: Re: Hadoop FS shell no longer working with S3 Native From: S D To: Hadoop Mailing List Content-Type: multipart/alternative; boundary=0016e6470ef85e0dfd0464531d40 X-Virus-Checked: Checked by ClamAV on apache.org --0016e6470ef85e0dfd0464531d40 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit My fault on this one. I mistakenly thought the environment variables (AMAZON_ACCESS_KEY_ID and AMAZON_SECRET_ACCESS_KEY) would override values set in hadoop-site.xml; I now see that this is not the case for the Hadoop FS shell commands. John On Wed, Mar 4, 2009 at 5:18 PM, S D wrote: > I'm using Hadoop 0.19.0 with S3 Native. Up until a few days ago I was > successfully able to use the various shell functions successfully; e.g., > hadoop dfs -ls . > To ensure access to my Amazon S3 Native data store I set the following > environment variables: AMAZON_ACCESS_KEY_ID and AMAZON_SECRET_ACCESS_KEY. Up > until this morning, this was working fine. Today I tried invoking the above > shell command (along with several others) and received the following error: > > Exception in thread "main" org.apache.hadoop.fs.s3.S3Exception: > org.jets3t.service.S3ServiceException: S3 PUT failed for '/' XML Error > Message: encoding="UTF-8"?>InvalidAccessKeyIdThe AWS > Access Key Id you provided does not exist in our > records.9294E59A199FB551HPdkhanFEvbz50k5FdwCgQRdOjO4aIBODXiMcBwy6DX7Ve3Jx2uXnujT6oEBhJpN882... > > I have not changed my Amazon access identifiers and I can still use my S3 > Firefox Organizer to access my S3 data (using the same AMAZON_ACCESS_KEY_ID > and AMAZON_SECRET_ACCESS_KEY as before). > > Has anyone else experienced this problem? Has something changed with the > API that I am unaware of? > > Thanks, > John > > > --0016e6470ef85e0dfd0464531d40--