Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9248F11C4C for ; Thu, 28 Aug 2014 19:17:16 +0000 (UTC) Received: (qmail 15759 invoked by uid 500); 28 Aug 2014 19:17:14 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 15705 invoked by uid 500); 28 Aug 2014 19:17:14 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 15693 invoked by uid 99); 28 Aug 2014 19:17:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Aug 2014 19:17:14 +0000 X-ASF-Spam-Status: No, hits=2.0 required=5.0 tests=SPF_NEUTRAL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Aug 2014 19:16:48 +0000 Received: from ben.nabble.com ([192.168.236.152]) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1XN5Bf-0008D9-D8 for user@spark.incubator.apache.org; Thu, 28 Aug 2014 12:16:47 -0700 Date: Thu, 28 Aug 2014 12:16:47 -0700 (PDT) From: Control To: user@spark.incubator.apache.org Message-ID: <1409253407378-13053.post@n3.nabble.com> In-Reply-To: <1409238401813-13035.post@n3.nabble.com> References: <1409238401813-13035.post@n3.nabble.com> Subject: Re: Print to spark log MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org I'm not sure if this is the case, but basic monitoring is described here: https://spark.apache.org/docs/latest/monitoring.html If it comes to something more sophisticated I was for example able to save some messages into local logs and view them in YARN UI via http by editing spark source code (use logInfo() method inside where needed) and build assembly again with maven. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Print-to-spark-log-tp13035p13053.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail: user-help@spark.apache.org