Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF8B511C0E for ; Thu, 31 Jul 2014 15:05:44 +0000 (UTC) Received: (qmail 91755 invoked by uid 500); 31 Jul 2014 15:05:35 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 91622 invoked by uid 500); 31 Jul 2014 15:05:35 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 91612 invoked by uid 99); 31 Jul 2014 15:05:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jul 2014 15:05:35 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sindhuht@gmail.com designates 74.125.82.177 as permitted sender) Received: from [74.125.82.177] (HELO mail-we0-f177.google.com) (74.125.82.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Jul 2014 15:05:28 +0000 Received: by mail-we0-f177.google.com with SMTP id w62so2902088wes.8 for ; Thu, 31 Jul 2014 08:05:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=n3urHIAdgz9Q3EAmSQ9nlZ42JfUdmDYNmJrtDdVUOqA=; b=KvDcnE7OxKMQPkUURcEcZsP77CuZToYKHz+l45o+5mxB4dWSADhfwGnl4srhJxxyun qNZ7eSSeNoZq8olGBSQF8B4xhrE+4d3LACngTpry0sg3a6Do6KW+wo91TxgeV+OBj2Vv gZvc6Aw4lzhhB3k5+ICpeFmlG2uhpXfm0/V8u7GTy12N/0O/dY3MlvV/TvcNlPr8yAVa 215vzoz83t6d2PgXAJlv/MNv8cVV9U/5okiSJvr+3FunchZvX88fkbiEqNAV06bGoQGK rN5bQI0stAT7J9OWyY+PXJPxQ+bJ9ARbpgP1hBwE5e0RGi7+BZ5vj7/751OFfkE/FvCN 85Lg== X-Received: by 10.194.7.36 with SMTP id g4mr17863873wja.37.1406819103594; Thu, 31 Jul 2014 08:05:03 -0700 (PDT) Received: from [192.168.1.27] (e177213150.adsl.alicedsl.de. [85.177.213.150]) by mx.google.com with ESMTPSA id ex4sm67155060wic.2.2014.07.31.08.05.02 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 31 Jul 2014 08:05:02 -0700 (PDT) From: Sindhu Hosamane Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Ideal number of mappers and reducers to increase performance Message-Id: Date: Thu, 31 Jul 2014 17:05:00 +0200 To: user@hadoop.apache.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) X-Virus-Checked: Checked by ClamAV on apache.org Hello friends , If i am running my experiment on a server with 2 processors (4 cores = each ) . To say it has 2 processors and 8 cores . What would be the ideal values for mapred.tasktracker.map.tasks.maximum = and mapred.tasktracker.reduce.tasks.maximum to get maximum performance. I am running cascalog queries on data of size 280 MB. I have multiple datanodes running on same machine. Your help is very much appreciated. Regards, sindhu