Return-Path: 
 <common-user-return-22912-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: (qmail 77068 invoked from network); 13 Jul 2010 10:05:24 -0000
Received: from unknown (HELO mail.apache.org) (140.211.11.3)
  by 140.211.11.9 with SMTP; 13 Jul 2010 10:05:24 -0000
Received: (qmail 45989 invoked by uid 500); 13 Jul 2010 10:05:22 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 45557 invoked by uid 500); 13 Jul 2010 10:05:17 -0000
Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-user@hadoop.apache.org>
List-Id: <common-user.hadoop.apache.org>
Reply-To: common-user@hadoop.apache.org
Delivered-To: mailing list common-user@hadoop.apache.org
Received: (qmail 45549 invoked by uid 99); 13 Jul 2010 10:05:16 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Jul 2010 10:05:16 +0000
X-ASF-Spam-Status: No, hits=2.2 required=10.0
	tests=FREEMAIL_FROM,HTML_MESSAGE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of tonci.buljan@gmail.com
 designates 209.85.214.48 as permitted sender)
Received: from [209.85.214.48] (HELO mail-bw0-f48.google.com) (209.85.214.48)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Jul 2010 10:05:08 +0000
Received: by bwz2 with SMTP id 2so4945434bwz.35
        for <common-user@hadoop.apache.org>;
 Tue, 13 Jul 2010 03:04:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:mime-version:received:received:date:message-id
         :subject:from:to:content-type;
        bh=YOKSpuJIFbHP+lFmjq64rvQ/mqp0k00JQeA9W4HruWI=;
        b=rX8as1T7Y6aCfKd3zwonolrvZgEmGS+jBMrOPxkEFL3piQVigM4z8853PUAnxPe0Cr
         yuAgOAHeopJId1JUmi4JBQ5Cp+OnOdvUST/LrnrWvZS/OLYHZVnbofjxdh1jziLLhuNy
         3jRdQL64s12iA24tmQRfgtHXkNHIqDcnb7oZc=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=mOBKwsVSdbeT/8xF2mlv9A9JB+w3+oJUZnhCC4cwDT5QAptx/uwH/zCsFeBZjiNwmA
         Va4FCea7BCv3XjBJb1itLPCixhK6p8WcaiVGy+UmgPR24ECvJlEjXom0jTp1T7saTDWK
         p8g8nVomzNFJOIdvqjXx9Gjx6Ie7qyCwvwLv4=
MIME-Version: 1.0
Received: by 10.204.141.16 with SMTP id k16mr11721509bku.177.1279015488407;
	Tue, 13 Jul 2010 03:04:48 -0700 (PDT)
Received: by 10.204.112.141 with HTTP; Tue, 13 Jul 2010 03:04:48 -0700 (PDT)
Date: Tue, 13 Jul 2010 12:04:48 +0200
Message-ID: <AANLkTikoHyZ-40IE_Pbi0vM7GbrTEckyFVzcDUL1MfJb@mail.gmail.com>
Subject: Please help...
From: Tonci Buljan <tonci.buljan@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015175cd138d94783048b41ff0b
X-Virus-Checked: Checked by ClamAV on apache.org

--0015175cd138d94783048b41ff0b
Content-Type: text/plain; charset=ISO-8859-1

Please help me, I can't figure out how to fix this problem.
I have a cluster of virtual machines under VMWare (windows XP is original
OS):

Ubuntu 8.10
Intel Pentium DUAL CPU E2180 @ 2 GHZ
Memory 1024 MB

I have a namenode and 8 more datanodes.
I want to start teragen and terasort programs and do a benchmark analysis of
a cluster running  1, 3 and all 8 datanodes.
Datanodes have only 20GB configured HDFS capacity each, so it is a total of
cca 150GB total.
I have no problem generating the input data with 2 or 8 maps but problem
comes out with terasort. When it comes to reduce phase, it generates a
following error:

10/07/13 10:59:40 INFO mapred.JobClient: Task Id :
attempt_201007131052_0002_r_000000_0, Status : FAILED
Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.


As I understand I have to setup these parameters in mapred-site.xml to
override default values:

<property>
  <name>mapred.map.tasks</name>
  <value>?</value>
</property>
<property>
  <name>mapred.reduce.tasks</name>
  <value>?</value>
</property>

Does anyone know how to setup number of reducers so that it works :).

Thank you...

--0015175cd138d94783048b41ff0b--