hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xuzq (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HDFS-14117) RBF: We can only delete the files or dirs of one subcluster in a cluster with multiple subclusters when trash is enabled
Date Thu, 30 May 2019 09:25:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-14117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851678#comment-16851678
] 

xuzq edited comment on HDFS-14117 at 5/30/19 9:24 AM:
------------------------------------------------------

Like this:
 * /home/hdfs/dir1 mount to ns1
 * /home/hdfs/dir2 mount to ns2
 * /home/hdfs/dir3 mount to ns3
 * /user/hdfs mount to ns1

when we delete /home/hdfs/dir3/file3, it will be automatically moved to /user/hdfs/.Trash/Current/home/hdfs/dir3/file3
in ns3.

It doesn't focus on the real mount point of /user/hdfs.


was (Author: xuzq_zander):
Like this:
 * /home/hdfs/dir1 mount to ns1
 * /home/hdfs/dir2 mount to ns2
 * /home/hdfs/dir3 mount to ns3
 * /user/hdfs mount to ns1

when we delete /home/hdfs/dir3/file3, it will be automatically moved to /user/hdfs/.Trash/Current/home/hdfs/dir3/file3
in ns3.

It don't focus on the real mount point of /user/hdfs.

> RBF: We can only delete the files or dirs of one subcluster in a cluster with multiple
subclusters when trash is enabled
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-14117
>                 URL: https://issues.apache.org/jira/browse/HDFS-14117
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: venkata ramkumar
>            Priority: Major
>              Labels: RBF
>         Attachments: HDFS-14117-HDFS-13891.001.patch, HDFS-14117-HDFS-13891.002.patch,
HDFS-14117-HDFS-13891.003.patch, HDFS-14117-HDFS-13891.004.patch, HDFS-14117-HDFS-13891.005.patch,
HDFS-14117-HDFS-13891.006.patch, HDFS-14117-HDFS-13891.007.patch, HDFS-14117-HDFS-13891.008.patch,
HDFS-14117-HDFS-13891.009.patch, HDFS-14117-HDFS-13891.010.patch, HDFS-14117-HDFS-13891.011.patch,
HDFS-14117-HDFS-13891.012.patch, HDFS-14117-HDFS-13891.013.patch, HDFS-14117-HDFS-13891.014.patch,
HDFS-14117-HDFS-13891.015.patch, HDFS-14117-HDFS-13891.016.patch, HDFS-14117-HDFS-13891.017.patch,
HDFS-14117-HDFS-13891.018.patch, HDFS-14117-HDFS-13891.019.patch, HDFS-14117-HDFS-13891.020.patch,
HDFS-14117.001.patch, HDFS-14117.002.patch, HDFS-14117.003.patch, HDFS-14117.004.patch, HDFS-14117.005.patch
>
>
> When we delete files or dirs in hdfs, it will move the deleted files or dirs to trash
by default.
> But in the global path we can only mount one trash dir /user. So we mount trash dir /user
of the subcluster ns1 to the global path /user. Then we can delete files or dirs of ns1, but
when we delete the files or dirs of another subcluser, such as hacluster, it will be failed.
> h1. Mount Table
> ||Global path||Target nameservice||Target path||Order||Read only||Owner||Group||Permission||Quota/Usage||Date
Modified||Date Created||
> |/test|hacluster2|/test| | |securedn|users|rwxr-xr-x|[NsQuota: -/-, SsQuota: -/-]|2018/11/29
14:37:42|2018/11/29 14:37:42|
> |/tmp|hacluster1|/tmp| | |securedn|users|rwxr-xr-x|[NsQuota: -/-, SsQuota: -/-]|2018/11/29
14:37:05|2018/11/29 14:37:05|
> |/user|hacluster2,hacluster1|/user|HASH| |securedn|users|rwxr-xr-x|[NsQuota: -/-, SsQuota:
-/-]|2018/11/29 14:42:37|2018/11/29 14:38:20|
> commands: 
> {noformat}
> 1./opt/HAcluater_ram1/install/hadoop/router/bin> ./hdfs dfs -ls /test/.
> 18/11/30 11:00:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> Found 1 items
> -rw-r--r-- 3 securedn supergroup 8081 2018-11-30 10:56 /test/hdfs.cmd
> 2./opt/HAcluater_ram1/install/hadoop/router/bin> ./hdfs dfs -ls /tmp/.
> 18/11/30 11:00:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> Found 1 items
> -rw-r--r--   3 securedn supergroup       6311 2018-11-30 10:57 /tmp/mapred.cmd
> 3../opt/HAcluater_ram1/install/hadoop/router/bin> ./hdfs dfs -rm /tmp/mapred.cmd
> 18/11/30 11:01:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> rm: Failed to move to trash: hdfs://router/tmp/mapred.cmd: rename destination parent
/user/securedn/.Trash/Current/tmp/mapred.cmd not found.
> 4./opt/HAcluater_ram1/install/hadoop/router/bin> ./hdfs dfs -rm /test/hdfs.cmd
> 18/11/30 11:01:20 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> 18/11/30 11:01:22 INFO fs.TrashPolicyDefault: Moved: 'hdfs://router/test/hdfs.cmd' to
trash at: hdfs://router/user/securedn/.Trash/Current/test/hdfs.cmd
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message