hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13683) HDFS StoragePolicy commands should work with Federation
Date Tue, 19 Jun 2018 17:01:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517309#comment-16517309
] 

Xiao Chen commented on HDFS-13683:
----------------------------------

Thanks Gabor for the investigation. Yes this looks to be a dup of HDFS-12857 :)

branch-3.0 is still active, which will release to branch-3.0.x (latest is 3.0.3). More details
at: http://hadoop.apache.org/versioning.html

> HDFS StoragePolicy commands should work with Federation
> -------------------------------------------------------
>
>                 Key: HDFS-13683
>                 URL: https://issues.apache.org/jira/browse/HDFS-13683
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs, tools
>    Affects Versions: 3.0.0
>            Reporter: Gabor Bota
>            Assignee: Gabor Bota
>            Priority: Major
>
> In a federated cluster (defaultFS = viewfs://cluster3), getStoragePolicy with hdfs uri
will run into the following error:
> {noformat}
> [root@cdh6-0-0-centos73-17443-1 ~]# hdfs storagepolicies -getStoragePolicy -path hdfs://ns2/hbase/WALs/cdh6-0-0-centos73-17443-4.vpc.cloudera.com,22101,1527272361896
> IllegalArgumentException: Wrong FS: hdfs://ns2/hbase/WALs/cdh6-0-0-centos73-17443-4.vpc.cloudera.com,22101,1527272361896,
expected: viewfs://cluster3/
> {noformat}
> Taking a quick look at the code, I think [this|https://github.com/apache/hadoop/blob/3e37a9a70ba93430da1b47f2a8b50358348396b0/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/StoragePolicyAdmin.java#L106]
is the culprit:
> {code}
>  final FileSystem fs = FileSystem.get(conf);
> // should do: final FileSystem fs = p.getFilesystem(conf);
> {code}
> We should have a review of all shell and see if anything else is missing. At the minimum,
we should fix all places in StoragePolicyAdmin.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message