hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ranadip Chatterjee <ranadi...@gmail.com>
Subject Re: Time taken by -copyFromLocalHost for transferring data
Date Sat, 21 Feb 2015 11:23:57 GMT
$> time hadoop fs -put <local file> <hdfs path>

For small files, I would expect the time to have a significant variance
between runs. For larger files, it should be more consistent (since the
throughput will be bound by the network bandwidth of the local machine).
On 21 Feb 2015 08:43, "tesmai4@gmail.com" <tesmai4@gmail.com> wrote:

> Hi,
>
> How can I measure the time taken by -copyFromLocalHost for transferring my
> data from local host to HDFS?
>
> Regards,
> Tariq
>

Mime
View raw message