hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3598) WebHDFS: support file concat
Date Fri, 25 Jan 2013 21:57:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13563090#comment-13563090
] 

Tsz Wo (Nicholas), SZE commented on HDFS-3598:
----------------------------------------------

In order to use some DFS specific operations such as concat, setSafeMode, etc., we have to
cast FileSystem to DistributedFileSystem and then call the DistributedFileSystem methods.
 e.g.

{code}
//uri scheme must be hdfs://
DistributedFileSystem dfs = (DistributedFileSystem)FileSystem.get(uri);
dfs.concat(..);
{code}

If there are common operations available in both DistributedFileSystem and WebHdfsFileSystem.
 Then, adding HadoopDistributedFileSystem allows code to support both hdfs:// or webhdfs://
URIs.

{code}
//uri scheme could be hdfs:// or webhdfs://
HadoopDistributedFileSystem hdfs = (HadoopDistributedFileSystem)FileSystem.get(uri);
hdfs.concat(..);
{code}

                
> WebHDFS: support file concat
> ----------------------------
>
>                 Key: HDFS-3598
>                 URL: https://issues.apache.org/jira/browse/HDFS-3598
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: webhdfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Plamen Jeliazkov
>
> In trunk and branch-2, DistributedFileSystem has a new concat(Path trg, Path [] psrcs)
method.  WebHDFS should support it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message