commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Roger Whitcomb (JIRA)" <>
Subject [jira] [Updated] (VFS-555) Add ability to specify alternate HDFS configuration file
Date Thu, 08 Jan 2015 17:21:34 GMT


Roger Whitcomb updated VFS-555:
    Attachment: VFS-555.patch

Patch to implement this feature.  It has been tested within our application.

> Add ability to specify alternate HDFS configuration file
> --------------------------------------------------------
>                 Key: VFS-555
>                 URL:
>             Project: Commons VFS
>          Issue Type: Improvement
>    Affects Versions: 2.1
>         Environment: All
>            Reporter: Roger Whitcomb
>            Priority: Minor
>             Fix For: 2.1
>         Attachments: VFS-555.patch
> We need to access HDFS on an AWS installation from outside the AWS firewall.  The technique
is described here:
> In order to do this we need to set the "dfs.client.use.datanode.hostname=true" in an
alternate configuration file set after the default configuration is loaded.
> I propose to add a property "configName" to HdfsFileSystemConfigBuilder, and then code
in HdfsFileSystem to get the value of the property and set it in the Configuration.

This message was sent by Atlassian JIRA

View raw message