spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-1182) Sort the configuration parameters in configuration.md
Date Tue, 24 Feb 2015 04:03:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334361#comment-14334361
] 

Reynold Xin edited comment on SPARK-1182 at 2/24/15 4:02 AM:
-------------------------------------------------------------

Actually when I filed this ticket, I don't think there was extensive high level grouping of
config options (there was maybe two or three). I took a look at the latest grouping and they
looked reasonable. 

A few problems with the existing grouping:

1. Networking section actually contains some shuffle settings. Those should be moved into
shuffle.

2. Application Properties contains some serialization settings. Those should be moved into
Compression and Serialization.

3. Runtime Environment contains some Mesos specific setting. All the way down on the page
we link to each resource manager's own page for resource manager specific settings.

4. Scheduling section contains a mesos specific setting (spark.mesos.coarse).

5. It is sort of arbitrary that "Dynamic allocation" has its own section (at the very least,
"a" should be upper case.)

6. "spark.ui.view.acls" is in security, but it also belongs in UI. Where do we put stuff like
this?


Within each section, config options should probably be sorted alphabetically.




was (Author: rxin):
Actually when I filed this ticket, I don't think there was extensive high level grouping of
config options (there was maybe two or three). I took a look at the latest grouping and they
looked reasonable. 

A few problems with the existing grouping:

1. Networking section actually contains some shuffle settings. Those should be moved into
shuffle.

2. Application Properties contains some serialization settings. Those should be moved into
Compression and Serialization.

3. Runtime Environment contains some Mesos specific setting. All the way down on the page
we link to each resource manager's own page for resource manager specific settings.

4. Scheduling section contains a mesos specific setting (spark.mesos.coarse).

5. It is sort of arbitrary that "Dynamic allocation" has its own section (at the very least,
"a" should be upper case.)

6. "spark.ui.view.acls" is in security, but it also belongs in UI. Where do we put stuff like
this?




> Sort the configuration parameters in configuration.md
> -----------------------------------------------------
>
>                 Key: SPARK-1182
>                 URL: https://issues.apache.org/jira/browse/SPARK-1182
>             Project: Spark
>          Issue Type: Task
>          Components: Documentation
>            Reporter: Reynold Xin
>            Assignee: prashant
>            Priority: Minor
>
> It is a little bit confusing right now since the config options are all over the place
in some arbitrarily sorted order.
> https://github.com/apache/spark/blob/master/docs/configuration.md



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message