hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4044) Create symbolic links in HDFS
Date Thu, 20 Nov 2008 23:28:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649532#action_12649532
] 

Sanjay Radia commented on HADOOP-4044:
--------------------------------------

Druba wrote
* Archives - current implementation does not follow symbolic links.
* distcp - pure FileSystem client, does not follow symbolic links

What is the desirable default behavior when a user does a distcp or an archive of a subtree
that has symlinks to other 
volumes?
To avoid accidental copying of large amounts of data, I suspect that the default should be
to copy the symlink as a symlink
rather than follow the symlink and copy its target.
If this is indeed the desired default behavior then the patch will need to fix that.


On a related note,  symlinks to an archive will throw an exception/error when one tries to
follow it. That would require a fix to the archive file system; we should file a separate
jira to fix that in the future.

> Create symbolic links in HDFS
> -----------------------------
>
>                 Key: HADOOP-4044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4044
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>             Fix For: 0.20.0
>
>         Attachments: 4044_20081030spi.java, HADOOP-4044-strawman.patch, symLink1.patch,
symLink1.patch, symLink11.patch, symLink12.patch, symLink13.patch, symLink14.patch, symLink4.patch,
symLink5.patch, symLink6.patch, symLink8.patch, symLink9.patch
>
>
> HDFS should support symbolic links. A symbolic link is a special type of file that contains
a reference to another file or directory in the form of an absolute or relative path and that
affects pathname resolution. Programs which read or write to files named by a symbolic link
will behave as if operating directly on the target file. However, archiving utilities can
handle symbolic links specially and manipulate them directly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message