hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen He (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8673) HDFS reports file already exists if there is a file/dir name end with ._COPYING_
Date Mon, 29 Jun 2015 17:59:05 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chen He updated HDFS-8673:
--------------------------
    Attachment: HDFS-8673.001.patch

Thank you for reviewing my patch, [~stevel@apache.org]. Patch updated.  I like the "don't
do a copy" suggestion. Would you mind we create a new JIRA to track it?

> HDFS reports file already exists if there is a file/dir name end with ._COPYING_
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-8673
>                 URL: https://issues.apache.org/jira/browse/HDFS-8673
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.7.0
>            Reporter: Chen He
>         Attachments: HDFS-8673.000-WIP.patch, HDFS-8673.000.patch, HDFS-8673.001.patch
>
>
> Because CLI is using CommandWithDestination.java which add "._COPYING_" to the tail of
file name when it does the copy. It will cause problem if there is a file/dir already called
*._COPYING_ on HDFS.
> For file:
> -bash-4.1$ hadoop fs -put 5M /user/occ/
> -bash-4.1$ hadoop fs -mv /user/occ/5M /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> -rw-r--r--   1 occ supergroup    5242880 2015-06-26 05:16 /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -put 128K /user/occ/5M
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> -rw-r--r--   1 occ supergroup     131072 2015-06-26 05:19 /user/occ/5M
> For dir:
> -bash-4.1$ hadoop fs -mkdir /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> drwxr-xr-x   - occ supergroup          0 2015-06-26 05:24 /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -put 128K /user/occ/5M
> put: /user/occ/5M._COPYING_ already exists as a directory
> -bash-4.1$ hadoop fs -ls /user/occ/
> (/user/occ/5M._COPYING_ is gone)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message