hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HDFS-950) Add concat to FsShell
Date Fri, 05 Feb 2010 02:48:28 GMT

     [ https://issues.apache.org/jira/browse/HDFS-950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Eli Collins resolved HDFS-950.

    Resolution: Won't Fix

The specific context seems to be a fairly general problem--if you want to transfer a large
file in parallel you can't because HDFS doesn't support writing at arbitrary offsets (which
is a reasonable limitation) so doing multiple transfers and concatenating the results is a
reasonable workaround.   We're already exposing file system specific APIs through hadoop fs
(eg setrep). Perhaps we should make fs file system agnostic and add hadoop hdfs for those.

In any case, it's not a big limitation to make people use the jar, just makes it more inconvenient,
so I'll close this one out.

> Add concat to FsShell
> ---------------------
>                 Key: HDFS-950
>                 URL: https://issues.apache.org/jira/browse/HDFS-950
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: tools
>            Reporter: Eli Collins
> Would be nice if concat (HDFS-222) was exposed up to FsShell so users don't have to use
hadoop jar.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message