spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Erlandson <>
Subject RFC: Supporting the Scala drop Method for Spark RDDs
Date Mon, 21 Jul 2014 15:24:11 GMT
A few weeks ago I submitted a PR for supporting rdd.drop(n), under SPARK-2315:

Supporting the drop method would make some operations convenient, however it forces computation
of >= 1 partition of the parent RDD, and so it would behave like a "partial action" that
returns an RDD as the result.

I wrote up a discussion of these trade-offs here:

View raw message