hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rtejac <rte...@gmail.com>
Subject Re: QUick question
Date Wed, 28 Aug 2013 23:00:41 GMT
Hello Jamal, 

You can do "hadoop fs -getMerge <hdfspath>  <local path>" that merges in your
local machine, will merge all parts into 1 file.  And then you can do -copyFromLocal to HDFS.


On Aug 28, 2013, at 3:37 PM, jamal sasha <jamalshasha@gmail.com> wrote:

> I have data in format 1...
> 
> And there is this conversion utility to convert data to format 2 whcih works like this
> 
> restore input > output
> 
> and then I want to copy output to hdfs at /user/output
> 
> Is tehre a way that i can merge all these commands into single line like can i directly
pipe output to hdfs ?


Mime
View raw message