spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26289) cleanup enablePerfMetrics parameter from BytesToBytesMap
Date Thu, 06 Dec 2018 08:25:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711112#comment-16711112
] 

Apache Spark commented on SPARK-26289:
--------------------------------------

User 'heary-cao' has created a pull request for this issue:
https://github.com/apache/spark/pull/23244

> cleanup enablePerfMetrics parameter from BytesToBytesMap
> --------------------------------------------------------
>
>                 Key: SPARK-26289
>                 URL: https://issues.apache.org/jira/browse/SPARK-26289
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core, SQL
>    Affects Versions: 2.5.0
>            Reporter: caoxuewen
>            Priority: Major
>
> enablePerfMetrics was originally designed in BytesToBytesMap to control getNumHashCollisions
getTimeSpentResizingNs getAverageProbesPerLookup.
> However, as the Spark version gradual progress. This parameter is only used for getAverageProbesPerLookup
and always given to true when using BytesToBytesMap. it is also dangerous to determine whether
getAverageProbesPerLookup opens and throws an IllegalStateException exception. So this pr
will be remove enablePerfMetrics parameter from BytesToBytesMap. thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message