hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: CopyFromLocal
Date Tue, 22 May 2012 02:22:39 GMT
Ranjith,

Are you speaking of DistCp?
http://hadoop.apache.org/common/docs/current/distcp.html

An 'fs -copyFromLocal' otherwise just runs as a single program that
connects to your DFS nodes and writes data from a single client
thread, and is not distributed on its own.

On Tue, May 22, 2012 at 6:48 AM, Ranjith <ranjith.raghunath1@gmail.com> wrote:
>
> I have always wondered about this and and not sure as to phenomenon. When I fire a map
reduce job to copy data over in a distributed fashion I would expect to see mappers executing
the copy. What happens with a copy command from Hadoop fs?
>
> Thanks,
> Ranjith



-- 
Harsh J

Mime
View raw message