hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pierre ANCELOT <pierre...@gmail.com>
Subject Feed hdfs with external data.
Date Wed, 23 Jun 2010 08:23:14 GMT
Hi everyone,
I have a program that generates the data that's supposed to be treated by
hadoop.
It's a java program that should write right on hdfs.
So as a test, I do this:



            Configuration config = new Configuration();
            FileSystem dfs = FileSystem.get(config);
            dfs.mkdirs(new Path("/test"));

Which of course failed, certainly because it's unaware of the position of
the configuration files.
How should I do this?
Thanks.


P.S. Just in case, here's my error:

10/06/23 10:04:06 ERROR conf.Configuration: Failed to set
setXIncludeAware(true) for parser
gnu.xml.dom.JAXPFactory@1d6096:java.lang.UnsupportedOperationException:
This parser does not support specification "null" version "null"
java.lang.UnsupportedOperationException: This parser does not support
specification "null" version "null"
        at
javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590)
        at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1054)
        at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1030)
        at
org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980)
        at org.apache.hadoop.conf.Configuration.get(Configuration.java:436)
        at
org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:103)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
        at fr.tst.testhdfsfromlocal.HDFSWriter.<init>(HDFSWriter.java:29)
        at fr.tst.testhdfsfromlocal.HdfsTest.main(HdfsTest.java:8)
10/06/23 10:04:06 ERROR conf.Configuration: Failed to set
setXIncludeAware(true) for parser
gnu.xml.dom.JAXPFactory@7b7072:java.lang.UnsupportedOperationException:
This parser does not support specification "null" version "null"
java.lang.UnsupportedOperationException: This parser does not support
specification "null" version "null"
        at
javax.xml.parsers.DocumentBuilderFactory.setXIncludeAware(DocumentBuilderFactory.java:590)
        at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1054)
        at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1030)
        at
org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980)
        at org.apache.hadoop.conf.Configuration.get(Configuration.java:436)
        at
org.apache.hadoop.fs.FileSystem.getDefaultUri(FileSystem.java:103)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:95)
        at fr.tst.testhdfsfromlocal.HDFSWriter.<init>(HDFSWriter.java:29)
        at fr.tst.testhdfsfromlocal.HdfsTest.main(HdfsTest.java:8)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message