spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-21491) Performance enhancement: eliminate creation of intermediate collections
Date Fri, 21 Jul 2017 10:02:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16096079#comment-16096079
] 

Hyukjin Kwon edited comment on SPARK-21491 at 7/21/17 10:01 AM:
----------------------------------------------------------------

For me, I won't (don't) fix these but am fine if anyone is fond of it.
{{(collection.breakOut)}} does not looks apparently like a replacement of {{.toMap}} to me
at all and confusing ...

Fixing it in a (super) hot path is okay to me. If not, for me -0.



was (Author: hyukjin.kwon):
For me, I won't (don't) fix these but am fine if anyone is fond of it.
{{(collection.breakOut)}} does not looks like a replacement of {{.toMap}} to me at all ...

Fixing it in a (super) hot path is okay to me. If not, for me -0.


> Performance enhancement: eliminate creation of intermediate collections
> -----------------------------------------------------------------------
>
>                 Key: SPARK-21491
>                 URL: https://issues.apache.org/jira/browse/SPARK-21491
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>    Affects Versions: 2.2.0
>            Reporter: Iurii Antykhovych
>            Priority: Trivial
>
> Simple performance optimization in a few places of GraphX:
> {{Traversable.toMap}} can be replaced with {{collection.breakout}}.
> This would eliminate creation of an intermediate collection of tuples, see
> [Stack Overflow article|https://stackoverflow.com/questions/1715681/scala-2-8-breakout]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message