hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-4044) Create symbolic links in HDFS
Date Thu, 11 Sep 2008 16:53:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12630246#action_12630246
] 

dhruba borthakur commented on HADOOP-4044:
------------------------------------------

@Doug: Your example scenario is correct. It could be a major loss in functionality. But maybe
we can put in the additional complexity and reap the additional benefits at a later date.
I am assuming that the need for the additional functionality can wait for some time. 

@Raghu: I agree that synlinks have many general purpose use-cases. But there are also file
system systems (very similar to Hadoop :-))that do not support symlinks/hardlinks at all.


For symlinks supported by various OS: the OS calls the file system with a ??lookup?? call
for every path component. The filesystem resolves only one piece of the path component at
a time. In HDFS, the FileSystem is passed in the entire path. Thus, the technique to resolve
partial paths becomes messy and does not have any precedence. That's why I am proposing that
we delay this part of the functionality.

Comments/feedback welcome.

> Create symbolic links in HDFS
> -----------------------------
>
>                 Key: HADOOP-4044
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4044
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>         Attachments: symLink1.patch, symLink1.patch
>
>
> HDFS should support symbolic links. A symbolic link is a special type of file that contains
a reference to another file or directory in the form of an absolute or relative path and that
affects pathname resolution. Programs which read or write to files named by a symbolic link
will behave as if operating directly on the target file. However, archiving utilities can
handle symbolic links specially and manipulate them directly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message