commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roger Whitcomb (JIRA)" <j...@apache.org>
Subject [jira] [Created] (VFS-555) Add ability to specify alternate HDFS configuration file
Date Thu, 08 Jan 2015 17:20:34 GMT
Roger Whitcomb created VFS-555:
----------------------------------

             Summary: Add ability to specify alternate HDFS configuration file
                 Key: VFS-555
                 URL: https://issues.apache.org/jira/browse/VFS-555
             Project: Commons VFS
          Issue Type: Improvement
    Affects Versions: 2.1
         Environment: All
            Reporter: Roger Whitcomb
            Priority: Minor
             Fix For: 2.1


We need to access HDFS on an AWS installation from outside the AWS firewall.  The technique
is described here:  http://rainerpeter.wordpress.com/2014/02/12/connect-to-hdfs-running-in-ec2-using-public-ip-addresses/
In order to do this we need to set the "dfs.client.use.datanode.hostname=true" in an alternate
configuration file set after the default configuration is loaded.
I propose to add a property "configName" to HdfsFileSystemConfigBuilder, and then code in
HdfsFileSystem to get the value of the property and set it in the Configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message