hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "K S Nidhin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13038) Hadoop fs -getmerge with destination as hdfs path
Date Tue, 19 Apr 2016 22:26:25 GMT
K S Nidhin created HADOOP-13038:
-----------------------------------

             Summary: Hadoop fs -getmerge with destination as hdfs  path
                 Key: HADOOP-13038
                 URL: https://issues.apache.org/jira/browse/HADOOP-13038
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 2.6.4
            Reporter: K S Nidhin


Currently the hadoop getmerge option supports only merging the hdfs files to a destination
in local server. So this means the edgenode's disk volume would be used. Suppose we have limited
disk space in the edgenode , this process would not be possible.So it would be good if we
have an option to store the merged results into hdfs itself, which would ideally be the scenario
for the merged results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message