hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen He (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8673) HDFS reports file already exists if there is a file/dir name end with ._COPYING_
Date Fri, 26 Jun 2015 05:32:04 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chen He updated HDFS-8673:
--------------------------
    Description: 
Because CLI is using CommandWithDestination.java which add "._COPYING_" to the tail of file
name when it does the copy. It will cause problem if there is a file/dir already called *._COPYING_
on HDFS.

For file:
-bash-4.1$ hadoop fs -put 5M /user/occ/
-bash-4.1$ hadoop fs -mv /user/occ/5M /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
-rw-r--r--   1 occ supergroup    5242880 2015-06-26 05:16 /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -put 128K /user/occ/5M
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
-rw-r--r--   1 occ supergroup     131072 2015-06-26 05:19 /user/occ/5M

For dir:
-bash-4.1$ hadoop fs -mkdir /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
drwxr-xr-x   - occ supergroup          0 2015-06-26 05:24 /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -put 128K /user/occ/5M
put: /user/occ/5M._COPYING_ already exists as a directory
-bash-4.1$ hadoop fs -ls /user/occ/
(/user/occ/5M._COPYING_ is gone)

  was:
Because CLI is using CommandWithDestination.java which add {quote}"._COPYING_" {quote} to
the tail of file name when it does the copy. It will cause problem if there is a file/dir
already called *._COPYING_ on HDFS.

For file:
-bash-4.1$ hadoop fs -put 5M /user/occ/
-bash-4.1$ hadoop fs -mv /user/occ/5M /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
-rw-r--r--   1 occ supergroup    5242880 2015-06-26 05:16 /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -put 128K /user/occ/5M
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
-rw-r--r--   1 occ supergroup     131072 2015-06-26 05:19 /user/occ/5M

For dir:
-bash-4.1$ hadoop fs -mkdir /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -ls /user/occ/
Found 1 items
drwxr-xr-x   - occ supergroup          0 2015-06-26 05:24 /user/occ/5M._COPYING_
-bash-4.1$ hadoop fs -put 128K /user/occ/5M
put: /user/occ/5M._COPYING_ already exists as a directory
-bash-4.1$ hadoop fs -ls /user/occ/
(/user/occ/5M._COPYING_ is gone)


> HDFS reports file already exists if there is a file/dir name end with ._COPYING_
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-8673
>                 URL: https://issues.apache.org/jira/browse/HDFS-8673
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.7.0
>            Reporter: Chen He
>            Assignee: Chen He
>
> Because CLI is using CommandWithDestination.java which add "._COPYING_" to the tail of
file name when it does the copy. It will cause problem if there is a file/dir already called
*._COPYING_ on HDFS.
> For file:
> -bash-4.1$ hadoop fs -put 5M /user/occ/
> -bash-4.1$ hadoop fs -mv /user/occ/5M /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> -rw-r--r--   1 occ supergroup    5242880 2015-06-26 05:16 /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -put 128K /user/occ/5M
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> -rw-r--r--   1 occ supergroup     131072 2015-06-26 05:19 /user/occ/5M
> For dir:
> -bash-4.1$ hadoop fs -mkdir /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -ls /user/occ/
> Found 1 items
> drwxr-xr-x   - occ supergroup          0 2015-06-26 05:24 /user/occ/5M._COPYING_
> -bash-4.1$ hadoop fs -put 128K /user/occ/5M
> put: /user/occ/5M._COPYING_ already exists as a directory
> -bash-4.1$ hadoop fs -ls /user/occ/
> (/user/occ/5M._COPYING_ is gone)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message