Return-Path: Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: (qmail 25036 invoked from network); 28 Sep 2009 04:27:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 28 Sep 2009 04:27:44 -0000 Received: (qmail 58086 invoked by uid 500); 28 Sep 2009 04:27:44 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 57962 invoked by uid 500); 28 Sep 2009 04:27:44 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 57948 invoked by uid 99); 28 Sep 2009 04:27:43 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Sep 2009 04:27:43 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jason.hadoop@gmail.com designates 209.85.212.186 as permitted sender) Received: from [209.85.212.186] (HELO mail-vw0-f186.google.com) (209.85.212.186) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 28 Sep 2009 04:27:32 +0000 Received: by vws16 with SMTP id 16so2763639vws.2 for ; Sun, 27 Sep 2009 21:27:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=Qj0TR+2pPo+w69LacL08z2Ud5UvBVQyzAm1DoZe3hVk=; b=nQuVQ6iBPqK7SEbnImQpij79/mR4Zo3YdzMr6sRIQzvwH77rmiSd1JTY6eRxQNSGAH jqXTiata9T8yWkvt6qAuz0jgpD1DkMAvpVbEgdcwuO52pougikGKg6Xce6zJUHSN4cuE sFTsoYcWW2DYyy0py+zWlYwc3aA3LvDXEjtNc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=WAwKy1w7wbgFshS5aCtt1QQS6HCeX065G29npdrU9HIHBc5LiaUhIdhvR896JrRXMa OyNV1bGZbRBkBm2r/Sz+rUHzj0PDKr6/UXfWnakuHLzZ35vQ3wLghjmBb0/PIMybFAOM evZn1KR/Iexej7cEiYsnQqKHzsH2sSDzihg0k= MIME-Version: 1.0 Received: by 10.220.78.103 with SMTP id j39mr5003503vck.78.1254112031633; Sun, 27 Sep 2009 21:27:11 -0700 (PDT) In-Reply-To: <96c42cba0909032032v5f26fbf6k26b572cc86e250b9@mail.gmail.com> References: <96c42cba0909032032v5f26fbf6k26b572cc86e250b9@mail.gmail.com> Date: Sun, 27 Sep 2009 21:27:11 -0700 Message-ID: <314098690909272127x13868192sc12f68d484dd8e82@mail.gmail.com> Subject: Re: How to monitor HDFS performance without root privilege From: Jason Venner To: hdfs-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0016e646a4742770c304749bb644 X-Virus-Checked: Checked by ClamAV on apache.org --0016e646a4742770c304749bb644 Content-Type: text/plain; charset=ISO-8859-1 You can use ganglia, without root priviliges as well as iostat for low level disk io monitoring. On Thu, Sep 3, 2009 at 8:32 PM, Thanh Do wrote: > Hi every one, > I have access to a cluster with a bunch of workstations. And I can install > and run HDFS smoothly without the root privilege. I wonder if there is a way > to monitor HDFS performance (e.g. read/write throughput) without using any > performance monitoring tool (e.g. nmon, tcpdump, ...) that requires root > privilege. Any suggestion is appreciated. > > Thanks, > Thanh > -- Pro Hadoop, a book to guide you from beginner to hadoop mastery, http://www.amazon.com/dp/1430219424?tag=jewlerymall www.prohadoopbook.com a community for Hadoop Professionals --0016e646a4742770c304749bb644 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable You can use ganglia, without root priviliges as well as iostat for low leve= l disk io monitoring.


On Thu, Sep 3, = 2009 at 8:32 PM, Thanh Do <doducthanhbk@gmail.com> wrote:
Hi every one,
I have access to a cluster with a bunch of workstations. An= d I can install and run HDFS smoothly without the root privilege. I wonder = if there is a way to monitor HDFS performance (e.g. read/write throughput) = without using any performance monitoring tool (e.g. nmon, tcpdump, ...) tha= t requires root privilege. Any suggestion is appreciated.

Thanks,
Thanh



--
Pro Hadoop, a book to g= uide you from beginner to hadoop mastery,
http://www.amazon.com/dp/1430219424?tag= =3Djewlerymall
www.prohadoopbook.com a commun= ity for Hadoop Professionals
--0016e646a4742770c304749bb644--