Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3328C102C4 for ; Mon, 2 Mar 2015 07:21:11 +0000 (UTC) Received: (qmail 84973 invoked by uid 500); 2 Mar 2015 07:21:05 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 84856 invoked by uid 500); 2 Mar 2015 07:21:05 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 84836 invoked by uid 99); 2 Mar 2015 07:21:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2015 07:21:05 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gotomypc27@gmail.com designates 209.85.216.169 as permitted sender) Received: from [209.85.216.169] (HELO mail-qc0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Mar 2015 07:20:59 +0000 Received: by qcxr5 with SMTP id r5so23154590qcx.10 for ; Sun, 01 Mar 2015 23:20:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=fqTc9fXrdTrXB3h+mhoQWJG55sVrZ+DdpbHHMVKzw2Q=; b=jmAYWOKGsrENxVd4yXJY+x561eaUlwLCu6fxYR8qBuu/a6qILAGNSMCofGD8LKtN5O UV+/9MejWucwD+P5WKqfUG7zWzn70JKw0GVhdXUlV6ZiF+dwUPv+r3bEZ5oKqWu79OI7 dvuWdeSqy4j0E0lTLo5I0or5PkQYFXV0RJBKU28gT3x9/Nk4iFHoA43jhCm0MixEhfhF or4feXCPTaHRlt/lJdWUPLVN4LpEAYd8/YecocdTOpd/dYWagFPY9d3LEbdooMUh3+7I UBk5og5ZwxVXo2JtKkDXK8iQ0dbjEHF7Fto8cblkeLsuoTB+ziGkujbhQ4cXSx24SS5h HIOA== MIME-Version: 1.0 X-Received: by 10.140.202.17 with SMTP id x17mr50042134qha.50.1425280838888; Sun, 01 Mar 2015 23:20:38 -0800 (PST) Received: by 10.96.55.10 with HTTP; Sun, 1 Mar 2015 23:20:38 -0800 (PST) In-Reply-To: References: Date: Sun, 1 Mar 2015 23:20:38 -0800 Message-ID: Subject: Re: How to find bottlenecks of the cluster ? From: Krish Donald To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a1141cd4c1b73950510490eb7 X-Virus-Checked: Checked by ClamAV on apache.org --001a1141cd4c1b73950510490eb7 Content-Type: text/plain; charset=UTF-8 Basically we have 4 points to consider, CPU , Memory, IO and Network So how to see which one is causing the bottleneck ? What parameters we should consider etc ? On Sun, Mar 1, 2015 at 10:57 PM, Nishanth S wrote: > This is a vast topic.Can you tell what components are there in your data > pipe line and how data flows in to system and the way its processed.There > are several inbuilt tests like testDFSIO and terasort that you can run. > > -Nishan > > On Sun, Mar 1, 2015 at 9:45 PM, Krish Donald wrote: > >> Hi, >> >> I wanted to understand, how should we find out the bottleneck of the >> cluster? >> >> Thanks >> Krish >> > > --001a1141cd4c1b73950510490eb7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Basically we have 4 points to consider, CPU , Memory,= IO and Network

So how to see which one is causing= the bottleneck ?
What parameters we should consider etc ?
<= /div>

On Sun, Mar = 1, 2015 at 10:57 PM, Nishanth S <nishanth.2884@gmail.com> wrote:
This is a =C2= =A0vast =C2=A0topic.Can you tell what components are there in your data pip= e line and how data flows in to system and the way its processed.There are = several =C2=A0inbuilt tests like testDFSIO and terasort that you can run.
-Nishan

On Sun, Mar 1, = 2015 at 9:45 PM, Krish Donald <gotomypc27@gmail.com> wrot= e:
Hi,

I= wanted to understand, how should we find out the bottleneck of the cluster= ?

Thanks
K= rish


--001a1141cd4c1b73950510490eb7--