hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Da Zheng <zhengda1...@gmail.com>
Subject Re: Latency and speed of HDFS
Date Sat, 29 Jan 2011 03:26:20 GMT
Have you tried TestDFSIO? I think it's quite a good benchmark to measure the
performance of HDFS. If you want to know how to write data to HDFS directly, you
can read its code.


On 1/28/11 6:36 PM, Pei HE wrote:
> Hi all,
> I want to know the detailed performance of Hadoop.
> I am writing a client code to test the latency, transfer speed of
> HDFS, and the time of initiating a JVM for a task.
> Does anyone know that which classes can be called without running a
> whole map/reduce job to find out the performance of Hadoop?
> I am trying to create a DFSClient in the following way.
>                 Configuration conf = new Configuration();
> 		DFSClient client = new DFSClient(conf);
> 		client.exists("hdfs://localhost:9900/home/");
> But, a RemoteException was thrown.
> Could anyone help me about that?
> Thanks
> --
> Pei

View raw message