Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 26B78D404 for ; Sun, 21 Oct 2012 14:22:50 +0000 (UTC) Received: (qmail 92728 invoked by uid 500); 21 Oct 2012 14:22:45 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 92650 invoked by uid 500); 21 Oct 2012 14:22:44 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 92642 invoked by uid 99); 21 Oct 2012 14:22:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 21 Oct 2012 14:22:44 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of mlortiz@uci.cu designates 200.55.140.180 as permitted sender) Received: from [200.55.140.180] (HELO mx3.uci.cu) (200.55.140.180) by apache.org (qpsmtpd/0.29) with SMTP; Sun, 21 Oct 2012 14:22:39 +0000 Received: (qmail 4445 invoked by uid 507); 21 Oct 2012 14:22:12 -0000 Received: from 10.0.0.185 by ns3.uci.cu (envelope-from , uid 501) with qmail-scanner-2.01st (avp: 5.0.2.0. spamassassin: 3.0.6. perlscan: 2.01st. Clear:RC:1(10.0.0.185):. Processed in 0.952422 secs); 21 Oct 2012 14:22:12 -0000 Received: from unknown (HELO ucimail4.uci.cu) (10.0.0.185) by 0 with SMTP; 21 Oct 2012 14:22:11 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by ucimail4.uci.cu (Postfix) with ESMTP id 4C34D14C4006 for ; Sun, 21 Oct 2012 10:22:11 -0400 (CDT) X-Virus-Scanned: amavisd-new at uci.cu Received: from ucimail4.uci.cu ([127.0.0.1]) by localhost (ucimail4.uci.cu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0KQLpwzi3QUd; Sun, 21 Oct 2012 10:22:10 -0400 (CDT) Received: by ucimail4.uci.cu (Postfix, from userid 101) id 5318614C4001; Sun, 21 Oct 2012 10:22:10 -0400 (CDT) Received: from ucimail4.uci.cu (ucimail4.uci.cu [10.0.0.185]) by ucimail4.uci.cu (Postfix) with ESMTP id 428AA14C4001; Sun, 21 Oct 2012 10:22:10 -0400 (CDT) Date: Sun, 21 Oct 2012 10:22:10 -0400 (CDT) From: " Marcos Ortiz Valmaseda" To: Subash D'Souza Cc: user@hadoop.apache.org Subject: Re: Java heap space error Message-ID: <4d0e1116-c9fa-49d1-badf-9a820e5b18b7@ucimail4.uci.cu> In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit MIME-Version: 1.0 X-Mailer: Zimbra 7.1.3_GA_3346 (zclient/7.1.3_GA_3346) X-Virus-Checked: Checked by ClamAV on apache.org Regards, Subash. Can you share more information about your YARN cluster? ----- Mensaje original ----- De: Subash D'Souza Para: user@hadoop.apache.org Enviado: Sun, 21 Oct 2012 09:18:43 -0400 (CDT) Asunto: Java heap space error I'm running CDH 4 on a 4 node cluster each with 96 G of RAM. Up until last week the cluster was running until there was an error in the name node log file and I had to reformat it put the data back Now when I run hive on YARN. I keep getting a Java heap space error. Based on the research I did. I upped the my mapred.child.java.opts first from 200m to 400 m to 800m and I still have the same issue. It seems to fail near the 100% mapper mark I checked the log files and the only thing that it does output is java heap space error. Nothing more. Any help would be appreciated. Thanks Subash 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS... CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION http://www.uci.cu http://www.facebook.com/universidad.uci http://www.flickr.com/photos/universidad_uci 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS... CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION http://www.uci.cu http://www.facebook.com/universidad.uci http://www.flickr.com/photos/universidad_uci