hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12897) Path not found when we get the ec policy for a .snapshot dir
Date Fri, 05 Jan 2018 06:58:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16312582#comment-16312582
] 

Xiao Chen commented on HDFS-12897:
----------------------------------

Thanks for sharing more history [~rakeshr]. I think that's certainly the same bug in encryption
unless [~andrew.wang] says otherwise. The test didn't assert {{snap2Zone}} either.

In general, IMO the following on the same <subdir> of a snapshottable <dir> should
always respect the snapshot:
# mkdir {{subdir}}
# take snapshot s1 on {{dir}}
# do your thing on {{subdir}}
# take snapshot s2 on {{dir}}
Whatever 'thing' it is on step 3 (ec / ez / acl / xattr / storagepolicy / perm), {{dir/.snapshot/s1/subdir}}
should not have it, and {{dir/.snapshot/s2/subdir}} should have it.

My guess is in practice there hasn't been many usage this way, so this is only caught from
code review. I propose we fix EC here and file follow-ons for the others...

> Path not found when we get the ec policy for a .snapshot dir
> ------------------------------------------------------------
>
>                 Key: HDFS-12897
>                 URL: https://issues.apache.org/jira/browse/HDFS-12897
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: erasure-coding, hdfs, snapshots
>    Affects Versions: 3.0.0-alpha1, 3.1.0
>            Reporter: Harshakiran Reddy
>            Assignee: LiXin Ge
>         Attachments: HDFS-12897.001.patch, HDFS-12897.002.patch, HDFS-12897.003.patch
>
>
> Scenario:-
> ---------------
> Operation on snapshot dir.
> *EC policy*
> bin> ./hdfs ec -getPolicy -path /dir/
> RS-3-2-1024k
> bin> ./hdfs ec -getPolicy -path /dir/.snapshot/
> {{FileNotFoundException: Path not found: /dir/.snapshot}}
> bin> ./hdfs dfs -ls /dir/.snapshot/
> Found 2 items
> drwxr-xr-x   - user group          0 2017-12-05 12:27 /dir/.snapshot/s1
> drwxr-xr-x   - user group          0 2017-12-05 12:28 /dir/.snapshot/s2
> *Storagepolicies*
> bin> ./hdfs storagepolicies -getStoragePolicy -path /dir/.snapshot/
> {{The storage policy of /dir/.snapshot/ is unspecified}}
> bin> ./hdfs storagepolicies -getStoragePolicy -path /dir/
> The storage policy of /dir/:
> BlockStoragePolicy{COLD:2, storageTypes=[ARCHIVE], creationFallbacks=[], replicationFallbacks=[]}
> *Which is the correct behavior ?*



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message