commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roger Whitcomb (JIRA)" <>
Subject [jira] [Commented] (VFS-555) Add ability to specify alternate HDFS configuration file
Date Thu, 08 Jan 2015 17:23:34 GMT


Roger Whitcomb commented on VFS-555:

Since I'm an Apache committer, I propose to commit this change within a few days unless objections
are raised.  Thanks for opening up Commons to all committers!

> Add ability to specify alternate HDFS configuration file
> --------------------------------------------------------
>                 Key: VFS-555
>                 URL:
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.1
>         Attachments: VFS-555.patch
> We need to access HDFS on an AWS installation from outside the AWS firewall.  The technique
is described here:
> In order to do this we need to set the "dfs.client.use.datanode.hostname=true" in an
alternate configuration file set after the default configuration is loaded.
> I propose to add a property "configName" to HdfsFileSystemConfigBuilder, and then code
in HdfsFileSystem to get the value of the property and set it in the Configuration.

This message was sent by Atlassian JIRA

View raw message