Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4955F109CD for ; Tue, 8 Oct 2013 13:30:03 +0000 (UTC) Received: (qmail 1414 invoked by uid 500); 8 Oct 2013 13:30:01 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 1120 invoked by uid 500); 8 Oct 2013 13:29:55 -0000 Mailing-List: contact dev-help@spark.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@spark.incubator.apache.org Delivered-To: mailing list dev@spark.incubator.apache.org Received: (qmail 1108 invoked by uid 99); 8 Oct 2013 13:29:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Oct 2013 13:29:54 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of markus.losoi@gmail.com designates 209.85.214.52 as permitted sender) Received: from [209.85.214.52] (HELO mail-bk0-f52.google.com) (209.85.214.52) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Oct 2013 13:29:46 +0000 Received: by mail-bk0-f52.google.com with SMTP id e11so3189042bkh.39 for ; Tue, 08 Oct 2013 06:29:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:subject:date:message-id:mime-version:content-type :content-transfer-encoding:thread-index:content-language; bh=U9k68QZr+jO8mt8IVI8ckcUaXH0Zcj87YhPotFULFf8=; b=YKsoT60K1XPHmiK4e4UQOSqg0YW2iqnDTIt/ghzJ2AF/Mvnj7ADYOi0G/PMeBttODx t3QFoOpqFCzdjUiBtCA/iIi2JGiZFN0DNJ0HsrOApz/jvAwI67A3mqdGKqC9zP6pxiw8 1cGNumey2URfitfNIgVu0BTGVXj1hWzOBf0lXpOUReT7JBFEkgIV0DsQ5MlS6L3oNYgF NRgDkQYNGUpZAjaKvu4BFc4lXDEuBhC0I8+OzVrNjTGrFFpatsAbmOFM/K6ztFLOODQy kSBmmpxbpXD01p+B1OU0ihBzKyxSxhjvMvyg0GD/ahQN1SIAB39HGvJcEZs9r9E4MSmK i1Tg== X-Received: by 10.205.97.136 with SMTP id ck8mr8339bkc.59.1381238966398; Tue, 08 Oct 2013 06:29:26 -0700 (PDT) Received: from MLTPadE320 (wireless-86-50-141-185.open.aalto.fi. [86.50.141.185]) by mx.google.com with ESMTPSA id w9sm20513194bkn.12.1969.12.31.16.00.00 (version=TLSv1 cipher=RC4-SHA bits=128/128); Tue, 08 Oct 2013 06:29:25 -0700 (PDT) From: "Markus Losoi" To: Subject: Re: Development environments Date: Tue, 8 Oct 2013 16:29:08 +0300 Message-ID: <525408b5.0964cc0a.3ac2.ffff996c@mx.google.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: Ac7EKlwhMzCWmEcRRWiwLAQla7LdOg== Content-Language: fi X-Virus-Checked: Checked by ClamAV on apache.org > Hi Markus, > have a look at the bottom of this wiki page: > https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark > IntelliJ IDEA seems to be quite popular (that I am using myself) > although Eclipse should work fine, too. There is another sbt plugin for > generating Eclipse project files. The IDE seems to work nicely, but what is the fastest way to build Spark? If I make a change to the "core" module and choose "Make Module 'core'" from the "Build" menu in IntelliJ Idea, then the IDE compiles the source code. To create the "spark-assembly-0.8.0-incubating-hadoop1.0.4.jar" JAR file, I have run "sbt assembly" on the command line. However, this takes an impractically long time (843 s when I last ran it on my workstation with an Intel Core 2 Quad Q9400 and 8 GB of RAM). Is there any faster way? Best regards, Markus Losoi (markus.losoi@gmail.com)