Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7744F11AC8 for ; Mon, 11 Aug 2014 05:54:07 +0000 (UTC) Received: (qmail 76734 invoked by uid 500); 11 Aug 2014 05:54:00 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 76600 invoked by uid 500); 11 Aug 2014 05:54:00 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 76590 invoked by uid 99); 11 Aug 2014 05:53:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Aug 2014 05:53:59 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of hadoophive@gmail.com designates 209.85.223.173 as permitted sender) Received: from [209.85.223.173] (HELO mail-ie0-f173.google.com) (209.85.223.173) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Aug 2014 05:53:54 +0000 Received: by mail-ie0-f173.google.com with SMTP id tr6so9212357ieb.4 for ; Sun, 10 Aug 2014 22:53:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=BXsIieWzgogEzdotFH5tpbKocbrm6XO+1HKm/rIKdWY=; b=Ktrl49asLyXstFaR0m5SS0VN1+oX/cbYhgSGkspInWdqFDqzdXkilJQk2gxCn7LRLH W/rb3NQY1nNf2JqM+w0IbiJNJygfx8UtEWmUA3heHju+1gHR5LOJt5CzGLY7EsCKH9M9 oS9/z9f0LGsMZgyEOiQ8X29a69X5NxFMmDXcXkZnkndJ+fvNBqB2FK6xI0pOSZnWAd+8 aXHQfQ0nYKkaLGEuq8QsTy7s5vWu5KYRlRDan24d5CIblnjmvjAfHjfwlJEeZCJVTbwZ PcPMG/BZEZy9xS2xWGWWnxF/thky+STNeIDwE5KYsAKfsHfsE/Q1q0gQZlehFV+Qe1dO x+2g== MIME-Version: 1.0 X-Received: by 10.42.58.210 with SMTP id j18mr30642908ich.2.1407736413839; Sun, 10 Aug 2014 22:53:33 -0700 (PDT) Received: by 10.107.156.133 with HTTP; Sun, 10 Aug 2014 22:53:33 -0700 (PDT) Received: by 10.107.156.133 with HTTP; Sun, 10 Aug 2014 22:53:33 -0700 (PDT) In-Reply-To: <3669FB3C-3189-467A-A7A0-A92E9E37BF84@gmail.com> References: <3669FB3C-3189-467A-A7A0-A92E9E37BF84@gmail.com> Date: Mon, 11 Aug 2014 11:23:33 +0530 Message-ID: Subject: Re: Multiple datanodes on single machine !! From: hadoop hive To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf30334b49e2654e0500542c86 X-Virus-Checked: Checked by ClamAV on apache.org --20cf30334b49e2654e0500542c86 Content-Type: text/plain; charset=UTF-8 How much memory it have and how many maps and reducer you have set with how much heap size? On Aug 11, 2014 11:17 AM, "Sindhu Hosamane" wrote: > Hello, > > I have set up multiple datanodes on a single machine following the > instructions in http://mail-archives.apache.org/mod_mbox/hadoop- > common-user/201009.mbox/%3CA3EF3F6AF24E204B812D1D24CCC8 > D71A03688F76@mse16be2.mse16.exchange.ms%3E > So i see 2 datanodes up and running when i run jps command. > The machine on which i set this 2 datanode hadoop is very powerful - means > it has 96 cores . > But still i dont get significant performance from 2 datanodes . How do i > make sure 2 datanodes are being used. > Or why does performance fail with 2 datanodes on same machine even when i > work on a powerful machine? > > Because before tweaking hadoop with those mapped properties to improve > performance, i want know if i get any performance from 2 datanodes(since i > am working on a powerful server) > > Any of your advices would be helpful. > > --20cf30334b49e2654e0500542c86 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

How much memory it have and how many maps and reducer you ha= ve set with how much heap size?

On Aug 11, 2014 11:17 AM, "Sindhu Hosamane&= quot; <sindhuht@gmail.com> = wrote:
Hello,

So i see 2 datanodes up and running when i r= un jps command.
The machine on which i set this 2 datanode h= adoop is very powerful - means it has 96 cores .
But still i dont get significant performance= from 2 datanodes . =C2=A0How do i make sure 2 datanodes are being used.
Or why does performance fail with 2 datanode= s on same machine even when i work on a powerful machine?

Because before tweaking hadoop with those mapped properties =C2=A0to improv= e performance, i want know if i get any performance from 2 datanodes(since = i am working on a powerful server)

Any of your= advices would be helpful.=C2=A0

--20cf30334b49e2654e0500542c86--