hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Russell Jurney <russell.jur...@gmail.com>
Subject Re: Pig Output
Date Mon, 05 Dec 2011 21:39:38 GMT
hadoop dfs cat /my/path/* > single_file

Russell Jurney
twitter.com/rjurney
russell.jurney@gmail.com
datasyndrome.com

On Dec 5, 2011, at 12:30 PM, Aaron Griffith <aaron.c.griffith@gmail.com> wrote:

> Using PigStorage() my pig script output gets put into partial files on the hadoop
> file system.
>
> When I use the copyToLocal fuction from Hadoop it creates a local directory with
> all the partial files.
>
> Is there a way to copy the partial files from hadoop into a single local file?
>
> Thanks
>

Mime
View raw message