spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Rosen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-10296) add preservesParitioning parameter to RDD.map
Date Sat, 23 Jan 2016 23:50:39 GMT

     [ https://issues.apache.org/jira/browse/SPARK-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Rosen resolved SPARK-10296.
--------------------------------
    Resolution: Won't Fix

Given the limited interest in this feature, combined with the fact that this is easily achievable
via mapPartitions, the additional API complexity, code review time, and compatibility concerns
don't seem well-justified to me. Therefore, I'm going to mark this as "Won't fix" for now.
If anyone strongly disagrees, we can re-open.

> add preservesParitioning parameter to RDD.map
> ---------------------------------------------
>
>                 Key: SPARK-10296
>                 URL: https://issues.apache.org/jira/browse/SPARK-10296
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Esteban Donato
>            Priority: Minor
>
> It would be nice to add the Boolean parameter preservesParitioning with default false
to RDD.map method just as it is in RDD.mapPartitions method.
> If you agree I can submit a pull request with this enhancement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message