hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-6240) Rename operation is not consistent between different implementations of FileSystem
Date Wed, 16 Sep 2009 22:47:57 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756269#action_12756269
] 

Sanjay Radia commented on HADOOP-6240:
--------------------------------------

So proposal is:
* a renames within a directory is atomic for *ALL* FSs. Renames across dirs may be be atomic
depending on the FS but will always work.
I like this!
However, LocalFS uses Java rename and may not be able to support this.

Are there use cases for renames across dirs?
If so can I add a statement to the rename spec which says:
* Some FSs like hdfs support atomic rename across dirs within the same volume and partition.
Owen's method (FileContext#isWithinSamePartition(path1, path2)) lets an app find out if the
FS volumes are correctly configured to support the atomic rename across dirs.

In many FSs, renames across volumes throw an exception (ie they don't do a copy+delete).
What shall we do here?

Can the symlink spec be:
* Symlinks are supported on some FSs. On those that do, the symlinkReplace(..) operation is
guaranteed to be atomic.

> Rename operation is not consistent between different implementations of FileSystem
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-6240
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6240
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>             Fix For: 0.21.0
>
>
> The rename operation has many scenarios that are not consistently implemented across
file systems.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message