Return-Path: X-Original-To: apmail-spark-commits-archive@minotaur.apache.org Delivered-To: apmail-spark-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1150610C7B for ; Wed, 29 Apr 2015 01:28:49 +0000 (UTC) Received: (qmail 48133 invoked by uid 500); 29 Apr 2015 01:28:49 -0000 Delivered-To: apmail-spark-commits-archive@spark.apache.org Received: (qmail 48108 invoked by uid 500); 29 Apr 2015 01:28:49 -0000 Mailing-List: contact commits-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list commits@spark.apache.org Received: (qmail 48099 invoked by uid 99); 29 Apr 2015 01:28:48 -0000 Received: from eris.apache.org (HELO hades.apache.org) (140.211.11.105) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Apr 2015 01:28:48 +0000 Received: from hades.apache.org (localhost [127.0.0.1]) by hades.apache.org (ASF Mail Server at hades.apache.org) with ESMTP id CE19DAC0044 for ; Wed, 29 Apr 2015 01:28:48 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1676652 - in /spark: news/_posts/2015-04-17-spark-1-2-2-released.md news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md releases/_posts/2015-04-17-spark-release-1-2-2.md releases/_posts/2015-04-17-spark-release-1-3-1.md Date: Wed, 29 Apr 2015 01:28:48 -0000 To: commits@spark.apache.org From: pwendell@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20150429012848.CE19DAC0044@hades.apache.org> Author: pwendell Date: Wed Apr 29 01:28:48 2015 New Revision: 1676652 URL: http://svn.apache.org/r1676652 Log: Adding missing source files Added: spark/news/_posts/2015-04-17-spark-1-2-2-released.md spark/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md spark/releases/_posts/2015-04-17-spark-release-1-2-2.md spark/releases/_posts/2015-04-17-spark-release-1-3-1.md Added: spark/news/_posts/2015-04-17-spark-1-2-2-released.md URL: http://svn.apache.org/viewvc/spark/news/_posts/2015-04-17-spark-1-2-2-released.md?rev=1676652&view=auto ============================================================================== --- spark/news/_posts/2015-04-17-spark-1-2-2-released.md (added) +++ spark/news/_posts/2015-04-17-spark-1-2-2-released.md Wed Apr 29 01:28:48 2015 @@ -0,0 +1,16 @@ +--- +layout: post +title: Spark 1.2.2 and 1.3.1 released +categories: +- News +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- +We are happy to announce the availability of Spark 1.2.2 and Spark 1.3.1! These are both maintenance releases that collectively feature the work of more than 90 developers. + +To download either release, visit the downloads page. Added: spark/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md URL: http://svn.apache.org/viewvc/spark/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md?rev=1676652&view=auto ============================================================================== --- spark/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md (added) +++ spark/news/_posts/2015-04-20-spark-summit-east-2015-videos-posted.md Wed Apr 29 01:28:48 2015 @@ -0,0 +1,17 @@ +--- +layout: post +title: Spark Summit East 2015 Videos Posted +categories: +- News +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +The videos and slides for Spark Summit East 2015 are now all available online. Watch them to get the latest news from the Spark community as well as use cases and applications built on top. + +If you like what you see, consider joining us at the 2015 Spark Summit in San Francisco. Added: spark/releases/_posts/2015-04-17-spark-release-1-2-2.md URL: http://svn.apache.org/viewvc/spark/releases/_posts/2015-04-17-spark-release-1-2-2.md?rev=1676652&view=auto ============================================================================== --- spark/releases/_posts/2015-04-17-spark-release-1-2-2.md (added) +++ spark/releases/_posts/2015-04-17-spark-release-1-2-2.md Wed Apr 29 01:28:48 2015 @@ -0,0 +1,78 @@ +--- +layout: post +title: Spark Release 1.2.2 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +Spark 1.2.2 is a maintenance release containing stability fixes. This release is based on the [branch-1.2](https://github.com/apache/spark/tree/branch-1.2) maintenance branch of Spark. We recommend all 1.2.1 users to upgrade to this stable release. Contributions to this release came from 39 developers. + +To download Spark 1.2.2 visit the downloads page. + +### Fixes +Spark 1.2.2 contains bug fixes in several components. Some of the more important fixes are highlighted below. You can visit the [Spark issue tracker](https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.2.2%20ORDER%20BY%20priority%2C%20component) for the full list of fixes. + + +#### Spark Core + * Thread safety problem in Netty shuffle ([SPARK-6578](http://issues.apache.org/jira/browse/SPARK-6578)) + * Memory leak in JobProgressListener ([SPARK-5967](http://issues.apache.org/jira/browse/SPARK-5967)) + * Unable to launch on YARN 2.5.0 and later ([SPARK-4267](http://issues.apache.org/jira/browse/SPARK-4267)) + * YARN auxiliary shuffle issue in secure mode ([SPARK-5655](http://issues.apache.org/jira/browse/SPARK-5655)) + +#### PySpark + * Jobs hang during `collect` operation ([SPARK-6667](http://issues.apache.org/jira/browse/SPARK-6667)) + * Zip fails with serializer error ([SPARK-5973](http://issues.apache.org/jira/browse/SPARK-5973)) + * Memory leak using Spark SQL with PySpark ([SPARK-6055](http://issues.apache.org/jira/browse/SPARK-6055)) + * Hanging when using large broadcast variables ([SPARK-5363](http://issues.apache.org/jira/browse/SPARK-5363)) + +### Contributors +The following developers contributed to this release: + + * Andrew Or -- Bug fixes in Core and YARN + * Andrew Rowson -- Bug fixes in YARN + * Anselme Vignon -- Bug fixes in SQL + * Brennon York -- Bug fixes in GraphX + * Cheng Hao -- Bug fixes in Core + * Cheolsoo Park -- Bug fixes in YARN + * Davies Liu -- Improvements in PySpark; bug fixes in Streaming, Core, SQL, and PySpark; documentation in Core and PySpark + * Emre Sevinc -- Documentation in Core and MLlib; improvement in Core + * Gen TANG -- Bug fixes in EC2 + * Hari Shreedharan -- Bug fixes in Streaming + * Hung Lin -- Bug fixes in scheduler + * Iulian Dragos -- Test in Streaming + * Jacek Lewandowski -- Bug fixes in Core + * Jesper Lundgren -- Bug fixes in Streaming + * Josh Rosen -- Bug fixes in Java API, Streaming, tests, and Core + * Kashish Jain -- Bug fixes in YARN + * Kay Ousterhout -- Bug fixes in Core and SQL + * Kousuke Saruta -- Improvements in Streaming and tests + * Li Zhihui -- Documentation in Core + * Manoj Kumar -- Improvements in MLlib + * Matt Cheah -- Bug fixes in Core + * Michael Nazario -- Bug fixes in PySpark + * Mingyu Kim -- Bug fixes in Core + * Nathan McCarthy -- Bug fixes in Core + * Nicholas Chammas -- Bug fixes in EC2 + * Peng Xu -- Documentation in Core + * Reynold Xin -- Bug fixes in Core + * Ryan Williams -- Improvements in Core + * Sean Owen -- Improvements in EC2; bug fixes in Core, tests, YARN, Streaming, scheduler, and Web UI + * Shixiong Zhu -- Improvements in Shuffle + * Tathagata Das -- Bug fixes in Streaming and Web UI + * Venkata Ramana Gollamudi -- Improvement in Core + * Vladimir Grigor -- Bug fixes in EC2 + * Wang Tao -- Bug fixes in Core + * Winston Chen -- Bug fixes in PySpark + * Yin Huai -- Bug fixes in SQL + * Yuhao Yang -- Bug fixes in MLlib + * Zhan Zhang -- Bug fixes in Core + * Zhang, Liye -- Bug fixes in Core + +_Thanks to everyone who contributed!_ + Added: spark/releases/_posts/2015-04-17-spark-release-1-3-1.md URL: http://svn.apache.org/viewvc/spark/releases/_posts/2015-04-17-spark-release-1-3-1.md?rev=1676652&view=auto ============================================================================== --- spark/releases/_posts/2015-04-17-spark-release-1-3-1.md (added) +++ spark/releases/_posts/2015-04-17-spark-release-1-3-1.md Wed Apr 29 01:28:48 2015 @@ -0,0 +1,105 @@ +--- +layout: post +title: Spark Release 1.3.1 +categories: [] +tags: [] +status: publish +type: post +published: true +meta: + _edit_last: '4' + _wpas_done_all: '1' +--- + +Spark 1.3.1 is a maintenance release containing stability fixes. This release is based on the [branch-1.3](https://github.com/apache/spark/tree/branch-1.3) maintenance branch of Spark. We recommend all 1.3.0 users to upgrade to this stable release. Contributions to this release came from 60 developers. + +To download Spark 1.3.1 visit the downloads page. + +### Fixes +Spark 1.3.1 contains several bug fixes in Spark SQL and assorted fixes in other components. Some of the more important fixes are highlighted below. You can visit the [Spark issue tracker](https://issues.apache.org/jira/issues/?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%201.3.1%20ORDER%20BY%20priority%2C%20component) for the full list of fixes. + +#### Spark SQL + * Unable to use reserved words in DDL ([SPARK-6250](http://issues.apache.org/jira/browse/SPARK-6250)) + * Parquet no longer caches metadata ([SPARK-6575](http://issues.apache.org/jira/browse/SPARK-6575)) + * Bug when joining two Parquet tables ([SPARK-6851](http://issues.apache.org/jira/browse/SPARK-6851)) + * Unable to read parquet data generated by Spark 1.1.1 ([SPARK-6315](http://issues.apache.org/jira/browse/SPARK-6315)) + * Parquet data source may use wrong Hadoop FileSystem ([SPARK-6330](http://issues.apache.org/jira/browse/SPARK-6330)) + +#### Spark Streaming + * Potential for data loss during WAL recovery ([SPARK-6222](http://issues.apache.org/jira/browse/SPARK-6222)) + +#### PySpark + * Potential program hang when calling collect ([SPARK-6667](http://issues.apache.org/jira/browse/SPARK-6667)) + +#### Spark Core + * Thread safety issue in Netty shuffle ([SPARK-6578](http://issues.apache.org/jira/browse/SPARK-6578)) + * Memory leak in output committer map ([SPARK-6737](http://issues.apache.org/jira/browse/SPARK-6737)) + * Unable to perform fetch file when local directories run NFS ([SPARK-6313](http://issues.apache.org/jira/browse/SPARK-6313)) + * NPE when cancelling and using mix of job groups ([SPARK-6414](http://issues.apache.org/jira/browse/SPARK-6414)) + +### Contributors +The following developers contributed to this release: + + * Adam Budde -- Bug fixes in SQL + * Andrew Or -- Bug fixes in Core + * Andrey Zagrebin -- Improvement in SQL + * Bill Chambers -- Documentation in Core + * Cheng Lian -- Bug fixes and improvement in SQL + * Chet Mancini -- Improvements in Core and SQL + * Christophe Preaud -- Documentation in Core and YARN + * Daoyuan Wang -- New features in SQL + * Davies Liu -- Improvements in PySpark and SQL; bug fixes in tests, PySpark, and SQL; improvement in SQL + * Dean Chen -- Bug fixes in Core + * Doing Done -- Bug fixes in Core and SQL + * Hung Lin -- Bug fixes in scheduler + * Ilya Ganelin -- Improvements in Core + * Imran Rashid -- Bug fixes in Core + * Iulian Dragos -- Bug fixes in Core + * Jayson Sunshine -- Documentation in Core + * Jeremy Freeman -- Bug fixes in Streaming and MLlib + * Jongyoul Lee -- Improvements in Mesos; bug fixes in Core + * Joseph K. Bradley -- Documentation in PySpark, Streaming, SQL, MLlib, and Core + * Josh Rosen -- Improvements in Core; bug fixes in Java API, Core, scheduler, and Streaming + * Kai Sasaki -- Documentation in Core and MLlib; bug fixes in MLlib and PySpark + * Kalle Jepsen -- Improvements in PySpark + * Kamil Smuga -- Bug fixes in Core and PySpark + * Kay Ousterhout -- Bug fixes in Core, tests, and Web UI + * Kevin (Sangwoo) Kim -- Bug fixes in Core + * Kousuke Saruta -- Improvements in Streaming and tests + * Lev Khomich -- Improvements in Core + * Liang-Chi Hsieh -- Bug fixes in SQL + * Liangliang Gu -- Bug fixes in spark submit + * Lomig Megard -- Documentation in Core + * Marcelo Vanzin -- Bug fixes in Core and YARN + * Matt Aasted -- Bug fixes in EC2 + * Michael Armbrust -- Improvements in SQL; documentation in Core; bug fixes in SQL; improvement in Core and SQL + * Michael Griffiths -- Bug fixes in Windows and Core + * Milan Straka -- Bug fixes in PySpark + * Nan Zhu -- Bug fixes in Core and SQL + * Nathan McCarthy -- Bug fixes in Core + * Pei-Lun Lee -- Bug fixes in SQL + * Peter Parente -- Improvements in Core + * Peter Rudenko -- Documentation in Core + * Reynold Xin -- Improvements in Core; documentation in Core; bug fixes in Core; improvement in SQL + * Sean Owen -- Bug fixes in Core, tests, and SQL + * Shixiong Zhu -- Bug fixes in Core + * Tathagata Das -- Improvements in Core and Streaming; bug fixes in Streaming + * Thomas Graves -- Bug fixes in Core + * Tijo Thomas -- Bug fixes in Core and SQL + * Venkata Ramana Gollamudi -- Bug fixes in SQL + * Vinod KC -- Bug fixes in Core and SQL + * Volodymyr Lyubinets -- Improvements and bug fixes in SQL + * Xiangrui Meng -- New features in MLlib and PySpark; bug fixes in PySpark, MLlib, and SQL; documentation in Core and MLlib + * Yadong Qi -- Improvements in SQL + * Yanbo Liang -- Bug fixes in MLlib and SQL + * Yash Datta -- Improvements in SQL + * Yin Huai -- Improvements and bug fixes in SQL + * Yp Cat -- Bug fixes in SQL + * Yu ISHIKAWA -- Improvements in MLlib + * Yuri Saito -- Bug fixes in SQL + * Zhang, Liye -- Bug fixes in Core and Web UI + * Zhichao Li -- Bug fixes in Streaming and Web UI + * Zhichao Zhang -- Documentation in Core + +_Thanks to everyone who contributed!_ + --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org For additional commands, e-mail: commits-help@spark.apache.org