Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 73D2C10C4B for ; Wed, 8 Jan 2014 11:35:27 +0000 (UTC) Received: (qmail 60039 invoked by uid 500); 8 Jan 2014 11:35:15 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 59950 invoked by uid 500); 8 Jan 2014 11:35:14 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 59943 invoked by uid 99); 8 Jan 2014 11:35:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Jan 2014 11:35:13 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ashjain2@gmail.com designates 74.125.82.47 as permitted sender) Received: from [74.125.82.47] (HELO mail-wg0-f47.google.com) (74.125.82.47) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Jan 2014 11:35:07 +0000 Received: by mail-wg0-f47.google.com with SMTP id n12so1326145wgh.14 for ; Wed, 08 Jan 2014 03:34:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=YHDltvfhTVD2bSoghHInWa1iKvUeQnVMoNBzN15wUzs=; b=1H5kkmN2bXUuipyfC9gcpri4H+zW1ijml7FeqCdpB3crO6dzQ56XiK1KAo6i1BTzTF HHy3KB3IiODvPeobFDLQ2MUV9OPtDP3fqNV/4VBg7lhr/PdSMFCwo4jfpwwQiUxOrB65 l+H93DH3Qn5gLwl4k0geh+6IStskyZLz6782Pte0WQ8cCirraD0bYQ2yX3gOiUMjKp4/ JKDrTxukzoEXRGXPCcVyc/HmZX6RzoNuFg2oUHDLA+hTXMI1XalfbzkOV3DKeQzVuW1S nLOrEvF3bYZMPDhexiWNaX9hrJaiY8c85vNZWwKqpO+VG5+tsJ0fRFjyvKhirdxVx0wX H0dQ== MIME-Version: 1.0 X-Received: by 10.194.235.230 with SMTP id up6mr80769141wjc.30.1389180886982; Wed, 08 Jan 2014 03:34:46 -0800 (PST) Received: by 10.194.35.8 with HTTP; Wed, 8 Jan 2014 03:34:46 -0800 (PST) Date: Wed, 8 Jan 2014 17:04:46 +0530 Message-ID: Subject: Distributing the code to multiple nodes From: Ashish Jain To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bd915da4c268204ef73e129 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd915da4c268204ef73e129 Content-Type: text/plain; charset=ISO-8859-1 Hello All, I have a 2 node hadoop cluster running with a replication factor of 2. I have a file of size around 1 GB which when copied to HDFS is replicated to both the nodes. Seeing the block info I can see the file has been subdivided into 8 parts which means it has been subdivided into 8 blocks each of size 128 MB. I use this file as input to run the word count program. Some how I feel only one node is doing all the work and the code is not distributed to other node. How can I make sure code is distributed to both the nodes? Also is there a log or GUI which can be used for this? Please note I am using the latest stable release that is 2.2.0. ++Ashish --047d7bd915da4c268204ef73e129 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hello All,

I have a 2 node had= oop cluster running with a replication factor of 2. I have a file of size a= round 1 GB which when copied to HDFS is replicated to both the nodes. Seein= g the block info I can see the file has been subdivided into 8 parts which = means it has been subdivided into 8 blocks each of size 128 MB.=A0 I use th= is file as input to run the word count program. Some how I feel only one no= de is doing all the work and the code is not distributed to other node. How= can I make sure code is distributed to both the nodes? Also is there a log= or GUI which can be used for this?
Please note I am using the latest stable release that is 2.2.0.
++Ashish
--047d7bd915da4c268204ef73e129--