spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <>
Subject [jira] [Updated] (SPARK-11140) Replace file server in driver with RPC-based alternative
Date Wed, 25 Nov 2015 05:49:11 GMT


Reynold Xin updated SPARK-11140:
    Fix Version/s: 1.6.0

> Replace file server in driver with RPC-based alternative
> --------------------------------------------------------
>                 Key: SPARK-11140
>                 URL:
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>            Reporter: Marcelo Vanzin
>            Assignee: Marcelo Vanzin
>             Fix For: 1.6.0, 1.7.0
> As part of making configuring encryption easy in Spark, it would be better to use the
existing RPC channel between driver and executors to transfer files and jars added to the
> This would remove the need to start the HTTP server currently used for that purpose,
which needs to be configured to use SSL if encryption is wanted. SSL is kinda hard to configure
correctly in a multi-user, distributed environment.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message