Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C788C10CFF for ; Tue, 27 Jan 2015 20:46:16 +0000 (UTC) Received: (qmail 14390 invoked by uid 500); 27 Jan 2015 20:46:14 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 14315 invoked by uid 500); 27 Jan 2015 20:46:14 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 14296 invoked by uid 99); 27 Jan 2015 20:46:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Jan 2015 20:46:14 +0000 X-ASF-Spam-Status: No, hits=3.2 required=5.0 tests=FORGED_YAHOO_RCVD,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of antonymayi@yahoo.com designates 212.82.96.200 as permitted sender) Received: from [212.82.96.200] (HELO nm15-vm3.bullet.mail.ir2.yahoo.com) (212.82.96.200) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 27 Jan 2015 20:45:46 +0000 Received: from [212.82.98.125] by nm15.bullet.mail.ir2.yahoo.com with NNFMP; 27 Jan 2015 20:43:39 -0000 Received: from [212.82.98.85] by tm18.bullet.mail.ir2.yahoo.com with NNFMP; 27 Jan 2015 20:43:39 -0000 Received: from [127.0.0.1] by omp1022.mail.ir2.yahoo.com with NNFMP; 27 Jan 2015 20:43:39 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 534748.63510.bm@omp1022.mail.ir2.yahoo.com X-YMail-OSG: o7DfIJAVM1myKnsgJDyBOuC4XP9lZN3cKitX9hBaFld4MVHAkVPv6BeeguCYH2n HoE6v4mzIf9PywCj.mgkjXbJzXb2k4XSTgMe2HBD0Hw68NV5dKc2HOEkeWU5ECZX8.YEUpXznZr9 cZGLiY.I3z_cKRe.wAwuEhpDhNXl958tVdfIQOkqVe0mLaFAUSIeoe0qBPzGVawfjtP4uXcuvD2y MujuCI_O3uR10BOAcbSBJytK_7eXaN7jjhS11R6cfa9adSk6q0NAbVsmOpJAYvVT3.tqMQcQUZkP 6oEmNt5erVdonZ0G03QmxBWP1207BvYOygLh_CZV8fQxEcfFFTLZXWtbMn8WUTCrYxpL8gNDjQCr spJUkUGRELXgy.ofpjm_crXPiQ_u5nTA6bHXo2LDfdfFJ335El_1CAetbTj.pU9mvZfOMhY8z1f9 lYur1vT427PGIeq8s50she.Itgl1Oh2p8qGsPVTJjY.7FofXFknpS5SclMwTfGDzMJ7H6g92NZ.g fqXN9uzPtWt9zSSE- Received: by 217.12.9.9; Tue, 27 Jan 2015 20:43:39 +0000 Date: Tue, 27 Jan 2015 20:43:38 +0000 (UTC) From: Antony Mayi Reply-To: Antony Mayi To: "user@spark.apache.org" Message-ID: <1105769227.1562679.1422391418690.JavaMail.yahoo@mail.yahoo.com> Subject: java.lang.OutOfMemoryError: GC overhead limit exceeded MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_1562678_1165994673.1422391418688" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_1562678_1165994673.1422391418688 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Hi, I am using spark.yarn.executor.memoryOverhead=8192 yet getting executors crashed with this error. does that mean I have genuinely not enough RAM or is this matter of config tuning? other config options used:spark.storage.memoryFraction=0.3 SPARK_EXECUTOR_MEMORY=14G running spark 1.2.0 as yarn-client on cluster of 10 nodes (the workload is ALS trainImplicit on ~15GB dataset) thanks for any ideas,Antony. ------=_Part_1562678_1165994673.1422391418688 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Hi,

I am using spark.yarn.executor.memoryOverhead= =3D8192 yet getting executors crashed with this error.

does that mean I have genuinely not enough = RAM or is this matter of config tuning?

other config options used:

spark.storage.memoryFraction=3D0.3

<= div id=3D"yui_3_16_0_1_1422390669120_2680" dir=3D"ltr" class=3D"" style=3D"= ">SPARK_EXECUTOR_MEMORY=3D14G

running spark 1.2.0 as y= arn-client on cluster of 10 nodes (the workload is ALS trainImplicit on ~15= GB dataset)

thanks for any ideas,

Antony.

------=_Part_1562678_1165994673.1422391418688--