Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B5E6DD7E3 for ; Sun, 7 Oct 2012 19:29:10 +0000 (UTC) Received: (qmail 69207 invoked by uid 500); 7 Oct 2012 19:29:08 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 69120 invoked by uid 500); 7 Oct 2012 19:29:08 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 69109 invoked by uid 99); 7 Oct 2012 19:29:08 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 19:29:08 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of attilacsordas@gmail.com designates 74.125.82.176 as permitted sender) Received: from [74.125.82.176] (HELO mail-we0-f176.google.com) (74.125.82.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 07 Oct 2012 19:29:02 +0000 Received: by mail-we0-f176.google.com with SMTP id z53so2441545wey.35 for ; Sun, 07 Oct 2012 12:28:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=dZPCVl/haSmS5i6cF4WERY7uiPLDU2W+Dzp1C7iBuL8=; b=Jo6Umo2Xv/X546PMYmpqv/puXGBTR+GKtbFoP9m+OWUzCeJn+MrltrvtdWJAkbdokL zxJ1ZI5cMpjViean+HrfrblIoxSlrcIjtehFxIpaHyyTJkDmkd00Q4t2La2q72VWwCZY pi/SBdxUF4R4jPByOBh5f591gGda6ty/IY4QEBg+EtR+Uvvf/3cF0Eyt8Wlgm6WDmhcK 5fj52hEYxC4gcTjO4JggGAWhW4J8sUvq9QvFZvvSYNhx7wQbClsSH40ATqCoDNB0ezW1 7Z1aZLJzJWarVvLiOV1vro7KIlES+KKlnhKSWj8s2d5PLkj/gxpx2i+9BZDg6PUDitTy X08A== MIME-Version: 1.0 Received: by 10.180.80.100 with SMTP id q4mr3559957wix.20.1349638121368; Sun, 07 Oct 2012 12:28:41 -0700 (PDT) Received: by 10.194.59.103 with HTTP; Sun, 7 Oct 2012 12:28:41 -0700 (PDT) In-Reply-To: References: Date: Sun, 7 Oct 2012 20:28:41 +0100 Message-ID: Subject: Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue. From: Attila Csordas To: mapreduce-user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 mapred.tasktracker.map.tasks.maximum 10 mapred.tasktracker.reduce.tasks.maximum 6 Cheers, Attila On Sun, Oct 7, 2012 at 6:34 AM, Harsh J wrote: > Hi, > > What is your # of slots per TaskTracker? Your ulimit seems pretty > high. I'd set it to 1.5x times heap initially, i.e., 6291456 (6 GB) > and try. > > On Sun, Oct 7, 2012 at 3:50 AM, Attila Csordas wrote: >> some details to this problem: >> >> 12/10/05 12:13:27 INFO mapred.JobClient: map 0% reduce 0% >> 12/10/05 12:13:40 INFO mapred.JobClient: Task Id : >> attempt_201210051158_0001_m_000002_0, Status : FAILED >> java.lang.Throwable: Child Error >> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) >> Caused by: java.io.IOException: Task process exit with nonzero status of 134. >> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) >> >> attempt_201210051158_0001_m_000002_0: # >> attempt_201210051158_0001_m_000002_0: # There is insufficient memory >> for the Java Runtime Environment to continue. >> attempt_201210051158_0001_m_000002_0: # pthread_getattr_np >> >> in mapred-site.xml the following memory settings were set after a >> couple trials to get rid of the problem this way: >> >> >> mapred.child.java.opts >> -server -Xmx4096M -Djava.net.preferIPv4Stack=true >> >> >> >> mapred.child.ulimit >> 16777216 >> >> >> Cheers, >> Attila >> >> >> >> On Fri, Oct 5, 2012 at 10:50 AM, Steve Lewis wrote: >>> [We get 'There is insufficient memory for the Java Runtime Environment to >>> continue.' >>> any time we run any job including the most trivial word count process. It is >>> true I am generating a jar for a larger job but only running a version of >>> wordcount that worked well under 0.2 >>> Any bright ideas??? >>> This is a new 1.03 installation and nothing is known to work >>> >>> Steven M. Lewis PhD >>> 4221 105th Ave NE >>> Kirkland, WA 98033 >>> cell 206-384-1340 >>> skype lordjoe_com > > > > -- > Harsh J