hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sanjay Radia (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4044) Create symbolic links in HDFS
Date Thu, 20 Nov 2008 23:28:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649532#action_12649532

Sanjay Radia commented on HADOOP-4044:

Druba wrote
* Archives - current implementation does not follow symbolic links.
* distcp - pure FileSystem client, does not follow symbolic links

What is the desirable default behavior when a user does a distcp or an archive of a subtree
that has symlinks to other 
To avoid accidental copying of large amounts of data, I suspect that the default should be
to copy the symlink as a symlink
rather than follow the symlink and copy its target.
If this is indeed the desired default behavior then the patch will need to fix that.

On a related note,  symlinks to an archive will throw an exception/error when one tries to
follow it. That would require a fix to the archive file system; we should file a separate
jira to fix that in the future.

> Create symbolic links in HDFS
> -----------------------------
>                 Key: HADOOP-4044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4044
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>             Fix For: 0.20.0
>         Attachments: 4044_20081030spi.java, HADOOP-4044-strawman.patch, symLink1.patch,
symLink1.patch, symLink11.patch, symLink12.patch, symLink13.patch, symLink14.patch, symLink4.patch,
symLink5.patch, symLink6.patch, symLink8.patch, symLink9.patch
> HDFS should support symbolic links. A symbolic link is a special type of file that contains
a reference to another file or directory in the form of an absolute or relative path and that
affects pathname resolution. Programs which read or write to files named by a symbolic link
will behave as if operating directly on the target file. However, archiving utilities can
handle symbolic links specially and manipulate them directly.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message