Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB0D3D58C for ; Tue, 20 Nov 2012 17:17:49 +0000 (UTC) Received: (qmail 78174 invoked by uid 500); 20 Nov 2012 17:17:45 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 78044 invoked by uid 500); 20 Nov 2012 17:17:45 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 78037 invoked by uid 99); 20 Nov 2012 17:17:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Nov 2012 17:17:45 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Nov 2012 17:17:37 +0000 Received: by mail-ie0-f176.google.com with SMTP id 13so3088025iea.35 for ; Tue, 20 Nov 2012 09:17:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=hMd96xa3aDim4mdT7xPn3L8sAx/DmAL85r55smyt2oI=; b=coL9HH+dCw7+dYOv9qs+V5CrxIL7d+RaDOIhz0n2brtPdlhIiF6KSOtbOJV816jfHg H+WQwLrG3vQL8vY8oPzKR+xpiBOixTIUdlO/Tk6gh8n3rRZUg81PrM/zJrE9ytf/oXJH HxAh2YnpNWHKk3Fq1At43kz/JBFEbO1XGWq3dt9/N30YfU/5k2UPVXmPEFp58ZHMfuea yk92bZ+25XLBJ4X9sy0SqiRlSyUDRE6/2gge3OadKsT+2/JiF7dxF0/V4fvmy+3u7/22 SM/zKBJPB0akGU6M3XjsTXfhBAirT//aJdh9pdtFijeyG1qtX4wEBaEHR1Mv5yfcvu0q KJlg== Received: by 10.43.50.197 with SMTP id vf5mr14691020icb.13.1353431836434; Tue, 20 Nov 2012 09:17:16 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.64.41 with HTTP; Tue, 20 Nov 2012 09:16:55 -0800 (PST) In-Reply-To: References: From: Harsh J Date: Tue, 20 Nov 2012 22:46:55 +0530 Message-ID: Subject: Re: reducer not starting To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQljrSuz8myZdQ/m49QCe0Zb59WGv3BBPrmyz1chLrd/9QLoweQOWaE8YlaOhMezhw6A1WEk X-Virus-Checked: Checked by ClamAV on apache.org Your mappers are failing (possibly a user-side error or an environmental one) and are being reattempted by the framework (default behavior, attempts 4 times to avoid transient failure scenario). Visit your job's logs in the JobTracker web UI, to find more information on why your tasks fail. On Tue, Nov 20, 2012 at 10:22 PM, jamal sasha wrote: > > > > I am not sure whats happening, but I wrote a simple mapper and reducer > script. > > > > And I am testing it against a small dataset (like few lines long). > > > > For some reason reducer is just not starting.. and mapper is executing again > and again? > > > > 12/11/20 09:21:18 INFO streaming.StreamJob: map 0% reduce 0% > > 12/11/20 09:22:05 INFO streaming.StreamJob: map 50% reduce 0% > > 12/11/20 09:22:10 INFO streaming.StreamJob: map 100% reduce 0% > > 12/11/20 09:32:05 INFO streaming.StreamJob: map 50% reduce 0% > > 12/11/20 09:32:11 INFO streaming.StreamJob: map 0% reduce 0% > > 12/11/20 09:32:20 INFO streaming.StreamJob: map 50% reduce 0% > > 12/11/20 09:32:31 INFO streaming.StreamJob: map 100% reduce 0% > > 12/11/20 09:42:20 INFO streaming.StreamJob: map 50% reduce 0% > > 12/11/20 09:42:31 INFO streaming.StreamJob: map 0% reduce 0% > > 12/11/20 09:42:32 INFO streaming.StreamJob: map 50% reduce 0% > > 12/11/20 09:42:50 INFO streaming.StreamJob: map 100% reduce 0% > > > > > > Let me know if you want the code also. > > Any clues of where I am going wrong? > > Thanks > > > > > > -- Harsh J