hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HADOOP-9986) HDFS Compatible ViewFileSystem
Date Tue, 25 Mar 2014 17:26:18 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Kihwal Lee resolved HADOOP-9986.
--------------------------------

    Resolution: Invalid

> HDFS Compatible ViewFileSystem
> ------------------------------
>
>                 Key: HADOOP-9986
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9986
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Lohit Vijayarenu
>             Fix For: 2.0.6-alpha
>
>
> There are multiple scripts and projects like pig, hive, elephantbird refer to HDFS URI
as hdfs://namenodehostport/ or hdfs:/// . In federated namespace this causes problem because
supported scheme for federation is viewfs:// . We will have to force all users to change their
scripts/programs to be able to access federated cluster. 
> It would be great if thee was a way to map viewfs scheme to hdfs scheme without exposing
it to users. Opening this JIRA to get inputs from people who have thought about this in their
clusters.
> In our clusters we ended up created another class HDFSCompatibleViewFileSystem which
hijacks both hdfs.fs.impl and viewfs.fs.impl and passes down filesystem calls to ViewFileSystem.
Is there any suggested approach other than this?



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message