Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 78360 invoked from network); 7 Apr 2008 16:48:21 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 7 Apr 2008 16:48:21 -0000 Received: (qmail 60838 invoked by uid 500); 7 Apr 2008 16:48:17 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 60807 invoked by uid 500); 7 Apr 2008 16:48:17 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 60798 invoked by uid 99); 7 Apr 2008 16:48:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2008 09:48:17 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [81.169.154.44] (HELO heaven.kostyrka.org) (81.169.154.44) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2008 16:47:33 +0000 Received: from localhost (localhost [127.0.0.1]) by heaven.kostyrka.org (Postfix) with ESMTP id 89ABB4FD22 for ; Mon, 7 Apr 2008 18:47:44 +0200 (CEST) Received: from heaven.kostyrka.org ([127.0.0.1]) by localhost (heaven.kostyrka.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 10021-02 for ; Mon, 7 Apr 2008 18:47:44 +0200 (CEST) Received: from [192.168.2.33] (unknown [85.127.252.14]) by heaven.kostyrka.org (Postfix) with ESMTP id 323454FB05 for ; Mon, 7 Apr 2008 18:47:44 +0200 (CEST) Subject: Re: HDFS access/Jython examples From: Andreas Kostyrka To: core-user@hadoop.apache.org In-Reply-To: <1207585296.2742.3.camel@localhost> References: <1207585296.2742.3.camel@localhost> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-4/O4lDFjm70BuAYy+jFu" Date: Mon, 07 Apr 2008 18:48:06 +0200 Message-Id: <1207586886.2742.11.camel@localhost> Mime-Version: 1.0 X-Mailer: Evolution 2.12.3 X-Virus-Checked: Checked by ClamAV on apache.org --=-4/O4lDFjm70BuAYy+jFu Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Ok, I've traced it down to the following problem in S3FileSystem.initialize(): this.localFs =3D get(URI.create("file:///"), conf); Why this bombs I have no idea. OTOH, the cool thing here is, it's the last line, which means that catching this exception, and ignoring might help me in my quest to read/write data to HDFS/S3. Andreas Am Montag, den 07.04.2008, 18:21 +0200 schrieb Andreas Kostyrka: > Well, I'm getting the following funny errors: >=20 > Traceback (innermost last): > File "test.py", line 13, in ? > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1177= ) > at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:53) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1191) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:148) > at org.apache.hadoop.fs.FileSystem.getNamed(FileSystem.java:122) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:94) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.= java:39) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces= sorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:585) >=20 > My source code is: >=20 > import sys, glob, os >=20 > sys.path.append("./hadoop-0.16.2-core.jar") > sys.path.extend(glob.glob("lib/*.jar")) > from org.apache.hadoop.fs import * > from org.apache.hadoop.conf import Configuration, Configured > from org.apache.hadoop.fs.s3 import S3FileSystem, Jets3tFileSystemStore > from java.net import URI > c =3D Configuration() > c.set("fs.default.name", "s3://loohad") > c.set("fs.s3.awsAccessKeyId", "1SKTFXXJKF5EXJ7S5202") > c.set("fs.s3.awsSecretAccessKey", "MyKEY") > fs =3D FileSystem.get(c) > print fs >=20 --=-4/O4lDFjm70BuAYy+jFu Content-Type: application/pgp-signature; name=signature.asc Content-Description: Dies ist ein digital signierter Nachrichtenteil -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQBH+lBGHJdudm4KnO0RAgyvAKCQ9KP2zX8zOAmyi7nk3nanoMhqXACdEafw +zkHs2+LXeu7FZuGpwMxU+U= =8K3w -----END PGP SIGNATURE----- --=-4/O4lDFjm70BuAYy+jFu--