Return-Path: X-Original-To: apmail-spark-dev-archive@minotaur.apache.org Delivered-To: apmail-spark-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DA61E113D7 for ; Wed, 3 Sep 2014 20:46:11 +0000 (UTC) Received: (qmail 24435 invoked by uid 500); 3 Sep 2014 20:46:10 -0000 Delivered-To: apmail-spark-dev-archive@spark.apache.org Received: (qmail 24369 invoked by uid 500); 3 Sep 2014 20:46:10 -0000 Mailing-List: contact dev-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list dev@spark.apache.org Received: (qmail 24357 invoked by uid 99); 3 Sep 2014 20:46:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2014 20:46:10 +0000 X-ASF-Spam-Status: No, hits=1.5 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of zhunanmcgill@gmail.com designates 209.85.223.170 as permitted sender) Received: from [209.85.223.170] (HELO mail-ie0-f170.google.com) (209.85.223.170) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Sep 2014 20:45:43 +0000 Received: by mail-ie0-f170.google.com with SMTP id rl12so10471521iec.29 for ; Wed, 03 Sep 2014 13:45:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:message-id:in-reply-to:references:subject :mime-version:content-type; bh=H8+f3NYnJbO1Jdy0Jqyr7TO+bwjRSimdgM9yLcm0+18=; b=ZWZV/cQkv+FsG1ClKtp6vbt4kYmeIZD095/etTT7nPQ3fiKMFEkTCJOAcSH5MtB5ju 7fp7taiIBfn23rJnSg3jI0vn3aBQEqfWnBmNKpB350pBmzcszb2/3My3Ae2wT1flkF45 eQIW3XzaJ1CfaZlBOXUpWm0NiZ5bTnc0Doc1io//2dMxz2I9v68MbSJAWG0BxiE/U7Mk qN14CbDZhJfSb11HHcWDBbRsTxQcAjJuJMj/nb4wpXrOMDz3/0f5qTlbYR32h15dWbfb fLOTWJKCqFxbQSVsehAqRvFbDDgPWIuCG3obG6Pupr29jnF+Lw/rrfh/JbkEth8M4gbp 2ceA== X-Received: by 10.43.53.198 with SMTP id vr6mr105148icb.74.1409777142205; Wed, 03 Sep 2014 13:45:42 -0700 (PDT) Received: from [142.157.43.33] (wpa043033.Wireless.McGill.CA. [142.157.43.33]) by mx.google.com with ESMTPSA id hg4sm6441172igb.15.2014.09.03.13.45.41 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Wed, 03 Sep 2014 13:45:41 -0700 (PDT) Date: Wed, 3 Sep 2014 16:59:08 -0400 From: Nan Zhu To: Matei Zaharia Cc: Cheng Lian , "=?utf-8?Q?dev=40spark.apache.org?=" Message-ID: <1E9F7A2DD2D6408BA9F29BC2A0170697@gmail.com> In-Reply-To: References:

Subject: Re: [VOTE] Release Apache Spark 1.1.0 (RC4) X-Mailer: sparrow 1.6.4 (build 1176) MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="5407811c_238e1f29_3447" X-Virus-Checked: Checked by ClamAV on apache.org --5407811c_238e1f29_3447 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline +1 tested thrift server with our in-house application, everything works fine -- Nan Zhu On Wednesday, September 3, 2014 at 4:43 PM, Matei Zaharia wrote: > +1 > > Matei > > On September 3, 2014 at 12:24:32 PM, Cheng Lian (lian.cs.zju@gmail.com (mailto:lian.cs.zju@gmail.com)) wrote: > > +1. > > Tested locally on OSX 10.9, built with Hadoop 2.4.1 > > - Checked Datanucleus jar files > - Tested Spark SQL Thrift server and CLI under local mode and standalone > cluster against MySQL backed metastore > > > > On Wed, Sep 3, 2014 at 11:25 AM, Josh Rosen wrote: > > > +1. Tested on Windows and EC2. Confirmed that the EC2 pvm->hvm switch > > fixed the SPARK-3358 regression. > > > > > > On September 3, 2014 at 10:33:45 AM, Marcelo Vanzin (vanzin@cloudera.com (mailto:vanzin@cloudera.com)) > > wrote: > > > > +1 (non-binding) > > > > - checked checksums of a few packages > > - ran few jobs against yarn client/cluster using hadoop2.3 package > > - played with spark-shell in yarn-client mode > > > > On Wed, Sep 3, 2014 at 12:24 AM, Patrick Wendell > > wrote: > > > Please vote on releasing the following candidate as Apache Spark version > > > > 1.1.0! > > > > > > The tag to be voted on is v1.1.0-rc4 (commit 2f9b2bd): > > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=2f9b2bd7844ee8393dc9c319f4fefedf95f5e460 > > > > > > The release files, including signatures, digests, etc. can be found at: > > > http://people.apache.org/~pwendell/spark-1.1.0-rc4/ > > > > > > Release artifacts are signed with the following key: > > > https://people.apache.org/keys/committer/pwendell.asc > > > > > > The staging repository for this release can be found at: > > > https://repository.apache.org/content/repositories/orgapachespark-1031/ > > > > > > The documentation corresponding to this release can be found at: > > > http://people.apache.org/~pwendell/spark-1.1.0-rc4-docs/ > > > > > > Please vote on releasing this package as Apache Spark 1.1.0! > > > > > > The vote is open until Saturday, September 06, at 08:30 UTC and passes if > > > a majority of at least 3 +1 PMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Spark 1.1.0 > > > [ ] -1 Do not release this package because ... > > > > > > To learn more about Apache Spark, please see > > > http://spark.apache.org/ > > > > > > == Regressions fixed since RC3 == > > > SPARK-3332 - Issue with tagging in EC2 scripts > > > SPARK-3358 - Issue with regression for m3.XX instances > > > > > > == What justifies a -1 vote for this release? == > > > This vote is happening very late into the QA period compared with > > > previous votes, so -1 votes should only occur for significant > > > regressions from 1.0.2. Bugs already present in 1.0.X will not block > > > this release. > > > > > > == What default changes should I be aware of? == > > > 1. The default value of "spark.io.compression.codec" is now "snappy" > > > --> Old behavior can be restored by switching to "lzf" > > > > > > 2. PySpark now performs external spilling during aggregations. > > > --> Old behavior can be restored by setting "spark.shuffle.spill" to > > > > > > > "false". > > > > > > 3. PySpark uses a new heuristic for determining the parallelism of > > > shuffle operations. > > > --> Old behavior can be restored by setting > > > "spark.default.parallelism" to the number of cores in the cluster. > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org (mailto:dev-unsubscribe@spark.apache.org) > > > For additional commands, e-mail: dev-help@spark.apache.org (mailto:dev-help@spark.apache.org) > > > > > > > > > > > > > -- > > Marcelo > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org (mailto:dev-unsubscribe@spark.apache.org) > > For additional commands, e-mail: dev-help@spark.apache.org (mailto:dev-help@spark.apache.org) > > > > > --5407811c_238e1f29_3447--