Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3ACEE104B0 for ; Fri, 16 Jan 2015 17:58:05 +0000 (UTC) Received: (qmail 9042 invoked by uid 500); 16 Jan 2015 17:58:06 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 8970 invoked by uid 500); 16 Jan 2015 17:58:06 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 8958 invoked by uid 99); 16 Jan 2015 17:58:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jan 2015 17:58:05 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sparkhealthanalytics@gmail.com designates 209.85.217.194 as permitted sender) Received: from [209.85.217.194] (HELO mail-lb0-f194.google.com) (209.85.217.194) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jan 2015 17:57:39 +0000 Received: by mail-lb0-f194.google.com with SMTP id u14so2017765lbd.1 for ; Fri, 16 Jan 2015 09:56:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=9rCvup6J7sMmJSMuDP/iLoxLf1I4rh3GJzzm7fTdwuU=; b=lW3fkqAOQY0O4sf+ZRCdvRJmI/kvy8YSIwkhzp9E5F8jK0gptkIQNuRdtHJk9IWKoe 4siUa1Q51WvlrOu6yRqHgC2gx7BKMRKhs1PcdSVDudtERcgU2SWAJ6Jhdnxhv+OzrIc0 p6YlMxz3HJJbefJ9BYMKHgAfEnqWMJVU9vxZ+LRiRFaEcmHaapW+3oidefhA8mhM6BbP 7jfOdhhz+hnCOBdnQ+ZazudyTo4yb8WAqRU6EJQ2H5rwumsucEsaKAPxT8YZFYTYO+S4 HqT6WQqsEGJ63DZMUhDvy9n1Cix0ViNQn3ejAUBxVZ7CX6ky4jPCT5KltQ7b6rPpbpRq 7ADA== MIME-Version: 1.0 X-Received: by 10.153.5.1 with SMTP id ci1mr16599332lad.67.1421430968124; Fri, 16 Jan 2015 09:56:08 -0800 (PST) Received: by 10.112.5.5 with HTTP; Fri, 16 Jan 2015 09:56:08 -0800 (PST) Date: Fri, 16 Jan 2015 12:56:08 -0500 Message-ID: Subject: Setting JVM options to Spark executors in Standalone mode From: Michel Dufresne To: dev@spark.apache.org Content-Type: multipart/alternative; boundary=001a1133a74eed8b0d050cc8afcc X-Virus-Checked: Checked by ClamAV on apache.org --001a1133a74eed8b0d050cc8afcc Content-Type: text/plain; charset=UTF-8 Hi All, I'm trying to set some JVM options to the executor processes in a standalone cluster. Here's what I have in *spark-env.sh*: jmx_opt="-Dcom.sun.management.jmxremote" > jmx_opt="${jmx_opt} -Djava.net.preferIPv4Stack=true" > jmx_opt="${jmx_opt} -Dcom.sun.management.jmxremote.port=9999" > jmx_opt="${jmx_opt} -Dcom.sun.management.jmxremote.rmi.port=9998" > jmx_opt="${jmx_opt} -Dcom.sun.management.jmxremote.ssl=false" > jmx_opt="${jmx_opt} -Dcom.sun.management.jmxremote.authenticate=false" > jmx_opt="${jmx_opt} -Djava.rmi.server.hostname=${SPARK_PUBLIC_DNS}" > export SPARK_WORKER_OPTS="${jmx_opt}" However the option are showing up on the *daemon* JVM not the *workers*. It has the same effect as if I was using SPARK_DAEMON_JAVA_OPTS (which should set it on the daemon process). Thanks in advance for your help, Michel --001a1133a74eed8b0d050cc8afcc--