commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bernd Eckenfels (JIRA)" <>
Subject [jira] [Commented] (VFS-555) Add ability to specify alternate HDFS configuration file
Date Thu, 08 Jan 2015 17:32:34 GMT


Bernd Eckenfels commented on VFS-555:

Looks good to me. I would change the log statement to verbose/debug not info and we need to
add some unit tests for this.

> Add ability to specify alternate HDFS configuration file
> --------------------------------------------------------
>                 Key: VFS-555
>                 URL:
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.1
>         Attachments: VFS-555.patch
> We need to access HDFS on an AWS installation from outside the AWS firewall.  The technique
is described here:
> In order to do this we need to set the "dfs.client.use.datanode.hostname=true" in an
alternate configuration file set after the default configuration is loaded.
> I propose to add a property "configName" to HdfsFileSystemConfigBuilder, and then code
in HdfsFileSystem to get the value of the property and set it in the Configuration.

This message was sent by Atlassian JIRA

View raw message