Return-Path: Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: (qmail 62129 invoked from network); 29 Jan 2011 05:54:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 Jan 2011 05:54:10 -0000 Received: (qmail 42749 invoked by uid 500); 29 Jan 2011 05:54:08 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 42365 invoked by uid 500); 29 Jan 2011 05:54:04 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 42350 invoked by uid 99); 29 Jan 2011 05:54:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Jan 2011 05:54:03 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of qwertymaniac@gmail.com designates 209.85.161.48 as permitted sender) Received: from [209.85.161.48] (HELO mail-fx0-f48.google.com) (209.85.161.48) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 29 Jan 2011 05:53:59 +0000 Received: by fxm2 with SMTP id 2so4476203fxm.35 for ; Fri, 28 Jan 2011 21:53:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type:content-transfer-encoding; bh=mxJATZt7JRQpsgXcYu3aDT5H3T106EsIim1Rfx6p18U=; b=NBahiTJoFP51Yw9+SChgYNhuPM1HLdo4B4ycosD6ZaXUUMcBiYu7cNjHg9ltCPceaC yDG5Ynahry1klc7QD2X1n9ZB0Ytiggvc5+YVM7Do/iUlobcS3uZb0CJzQZVEqYC6et+O G5Vf7tBZH69naV+6cWVoSrVkYvkN34DRiUBOo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; b=nntht7gsuy0+aOUkktsZsUU60eNuGnQz3sZn/1Mkfk32eV1Lcj7lnvubSyB7yCvqzi e6LC9oZFdA85QIRo8LDrjoIpiDhdGbPVThASuORUErRWu5IW8XRIP5sIjTFTTTw1Y/os 0FVqfEkxX7xbWgFEqyyCqfEkqhKD3BYrknnDU= Received: by 10.223.95.202 with SMTP id e10mr3328611fan.32.1296280417307; Fri, 28 Jan 2011 21:53:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.223.124.200 with HTTP; Fri, 28 Jan 2011 21:53:17 -0800 (PST) In-Reply-To: References: From: Harsh J Date: Sat, 29 Jan 2011 11:23:17 +0530 Message-ID: Subject: Re: Latency and speed of HDFS To: hdfs-user@hadoop.apache.org, peihe0@gmail.com, zhengda1936@gmail.com Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Moving discussion to hdfs-user mailing list: hdfs-user@hadoop.apache.com On Sat, Jan 29, 2011 at 5:06 AM, Pei HE wrote: > Hi all, > I want to know the detailed performance of Hadoop. > > I am writing a client code to test the latency, transfer speed of > HDFS, and the time of initiating a JVM for a task. > > Does anyone know that which classes can be called without running a > whole map/reduce job to find out the performance of Hadoop? > > I am trying to create a DFSClient in the following way. > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0Configuration conf =3D new Configuration()= ; > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0DFSClient client =3D new DFSClient(conf); > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0client.exists("hdfs://localhost:9900/home/= "); > But, a RemoteException was thrown. Would help to know what the cause for the throw of a RemoteException was. --=20 Harsh J www.harshj.com