Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 35024 invoked from network); 23 Jun 2010 08:23:49 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 23 Jun 2010 08:23:49 -0000 Received: (qmail 21431 invoked by uid 500); 23 Jun 2010 08:23:47 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 21027 invoked by uid 500); 23 Jun 2010 08:23:44 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 21019 invoked by uid 99); 23 Jun 2010 08:23:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 08:23:43 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of pierreact@gmail.com designates 74.125.82.176 as permitted sender) Received: from [74.125.82.176] (HELO mail-wy0-f176.google.com) (74.125.82.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 08:23:35 +0000 Received: by wyb39 with SMTP id 39so897650wyb.35 for ; Wed, 23 Jun 2010 01:23:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=YczidYDUCOockrqZrKMCqmFZvu9sBCKx24nIMiJmX/o=; b=jpIeKuapnW5PagCJfTs3Q5Q3n6NQ5URlORzojADRh5v73+qvKAo+a6bqmQLK84GpcA lGmHQCGLKVQnC5sAmgriBeYbZobefagWcOyg3jUOizeWj25lojfooewhd49tzbd27Aa+ SayQJD6WEbRBV5+g3LRTJSxHHCsa3E6mcrulA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=th4AcLmFO/GdEdqWzJkBmh2eoyGKTRvfnccoDBxS4STNbWpjDLSuidpfqEKIsbB10z hNEwOYFW642sEB+9b30j+9gVwViVLIbGBzKZifi45GHpPWPJ5xuByh1EfEok2nmsrxlc HwhDkxlx+VQFxQfXThcSK0svCWxCpWANjiV+c= MIME-Version: 1.0 Received: by 10.216.93.21 with SMTP id k21mr5603015wef.68.1277281394864; Wed, 23 Jun 2010 01:23:14 -0700 (PDT) Received: by 10.216.183.213 with HTTP; Wed, 23 Jun 2010 01:23:14 -0700 (PDT) Date: Wed, 23 Jun 2010 10:23:14 +0200 Message-ID: Subject: Feed hdfs with external data. From: Pierre ANCELOT To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016e6d7e9a3d1b41e0489ae3fb2 X-Virus-Checked: Checked by ClamAV on apache.org --0016e6d7e9a3d1b41e0489ae3fb2 Content-Type: text/plain; charset=ISO-8859-1 Hi everyone, I have a program that generates the data that's supposed to be treated by hadoop. It's a java program that should write right on hdfs. So as a test, I do this: Configuration config = new Configuration(); FileSystem dfs = FileSystem.get(config); dfs.mkdirs(new Path("/test")); Which of course failed, certainly because it's unaware of the position of the configuration files. How should I do this? Thanks. P.S. Just in case, here's my error: 10/06/23 10:04:06 ERROR conf.Configuration: Failed to set setXIncludeAware(true) for parser gnu.xml.dom.JAXPFactory@1d6096:java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null" java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null" at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1054) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1030) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980) at org.apache.hadoop.conf.Configuration.get(Configuration.java:436) at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:103) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) at fr.tst.testhdfsfromlocal.HDFSWriter.(HDFSWriter.java:29) at fr.tst.testhdfsfromlocal.HdfsTest.main(HdfsTest.java:8) 10/06/23 10:04:06 ERROR conf.Configuration: Failed to set setXIncludeAware(true) for parser gnu.xml.dom.JAXPFactory@7b7072:java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null" java.lang.UnsupportedOperationException: This parser does not support specification "null" version "null" at javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1054) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1030) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980) at org.apache.hadoop.conf.Configuration.get(Configuration.java:436) at org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:103) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95) at fr.tst.testhdfsfromlocal.HDFSWriter.(HDFSWriter.java:29) at fr.tst.testhdfsfromlocal.HdfsTest.main(HdfsTest.java:8) --0016e6d7e9a3d1b41e0489ae3fb2--