spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shivaram Venkataraman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-3115) Improve task broadcast latency for small tasks
Date Tue, 19 Aug 2014 02:24:18 GMT
Shivaram Venkataraman created SPARK-3115:
--------------------------------------------

             Summary: Improve task broadcast latency for small tasks
                 Key: SPARK-3115
                 URL: https://issues.apache.org/jira/browse/SPARK-3115
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 1.1.0
            Reporter: Shivaram Venkataraman
            Assignee: Reynold Xin


Broadcasting the task information helps reduce the amount of data transferred for large tasks.
However we've seen that this adds more latency for small tasks. It'll be great to profile
and fix this.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message