Return-Path: X-Original-To: apmail-spark-commits-archive@minotaur.apache.org Delivered-To: apmail-spark-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A316F10B95 for ; Wed, 11 Sep 2013 17:27:10 +0000 (UTC) Received: (qmail 60406 invoked by uid 500); 11 Sep 2013 17:27:09 -0000 Delivered-To: apmail-spark-commits-archive@spark.apache.org Received: (qmail 60314 invoked by uid 500); 11 Sep 2013 17:27:09 -0000 Mailing-List: contact commits-help@spark.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@spark.incubator.apache.org Delivered-To: mailing list commits@spark.incubator.apache.org Received: (qmail 60065 invoked by uid 99); 11 Sep 2013 17:27:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Sep 2013 17:27:06 +0000 X-ASF-Spam-Status: No, hits=-2000.7 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 11 Sep 2013 17:27:02 +0000 Received: (qmail 56630 invoked by uid 99); 11 Sep 2013 17:26:40 -0000 Received: from tyr.zones.apache.org (HELO tyr.zones.apache.org) (140.211.11.114) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Sep 2013 17:26:40 +0000 Received: by tyr.zones.apache.org (Postfix, from userid 65534) id A253C8BE35A; Wed, 11 Sep 2013 17:26:40 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: pwendell@apache.org To: commits@spark.incubator.apache.org Date: Wed, 11 Sep 2013 17:26:41 -0000 Message-Id: In-Reply-To: <61ff06dabc0f4fd8954b873112436e3b@git.apache.org> References: <61ff06dabc0f4fd8954b873112436e3b@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [02/13] git commit: Update Python API features X-Virus-Checked: Checked by ClamAV on apache.org Update Python API features Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/2425eb85 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/2425eb85 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/2425eb85 Branch: refs/heads/branch-0.8 Commit: 2425eb85ca709273c48958f81a81c8a04657ea1f Parents: 8c14f4b Author: Matei Zaharia Authored: Tue Sep 10 11:12:59 2013 -0700 Committer: Matei Zaharia Committed: Tue Sep 10 11:12:59 2013 -0700 ---------------------------------------------------------------------- docs/python-programming-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/2425eb85/docs/python-programming-guide.md ---------------------------------------------------------------------- diff --git a/docs/python-programming-guide.md b/docs/python-programming-guide.md index 5662e7d..f67a1cc 100644 --- a/docs/python-programming-guide.md +++ b/docs/python-programming-guide.md @@ -16,7 +16,7 @@ This guide will show how to use the Spark features described there in Python. There are a few key differences between the Python and Scala APIs: * Python is dynamically typed, so RDDs can hold objects of multiple types. -* PySpark does not yet support a few API calls, such as `lookup`, `sort`, and `persist` at custom storage levels. See the [API docs](api/pyspark/index.html) for details. +* PySpark does not yet support a few API calls, such as `lookup`, `sort`, and non-text input files, though these will be added in future releases. In PySpark, RDDs support the same methods as their Scala counterparts but take Python functions and return Python collection types. Short functions can be passed to RDD methods using Python's [`lambda`](http://www.diveintopython.net/power_of_introspection/lambda_functions.html) syntax: