hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gera Shegalov (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-9987) HDFS Compatible ViewFileSystem
Date Thu, 29 May 2014 08:33:01 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Gera Shegalov resolved HADOOP-9987.

    Resolution: Duplicate

> HDFS Compatible ViewFileSystem
> ------------------------------
>                 Key: HADOOP-9987
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9987
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Lohit Vijayarenu
>             Fix For: 2.0.6-alpha
> There are multiple scripts and projects like pig, hive, elephantbird refer to HDFS URI
as hdfs://namenodehostport/ or hdfs:/// . In federated namespace this causes problem because
supported scheme for federation is viewfs:// . We will have to force all users to change their
scripts/programs to be able to access federated cluster. 
> It would be great if thee was a way to map viewfs scheme to hdfs scheme without exposing
it to users. Opening this JIRA to get inputs from people who have thought about this in their
> In our clusters we ended up created another class HDFSCompatibleViewFileSystem which
hijacks both hdfs.fs.impl and viewfs.fs.impl and passes down filesystem calls to ViewFileSystem.
Is there any suggested approach other than this?

This message was sent by Atlassian JIRA

View raw message