ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Swapan Shridhar (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (AMBARI-22196) Refactor non-stack cluster-env configs to cluster settings
Date Tue, 10 Oct 2017 23:19:00 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-22196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199544#comment-16199544
] 

Swapan Shridhar edited comment on AMBARI-22196 at 10/10/17 11:18 PM:
---------------------------------------------------------------------

*API testing*

*Get all cluster-settings :*

{code:title=http://<host>:<port>/api/v1/cluster_settings/}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/",
"items": [
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"property_name": "agent_mounts_ignore_list"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/alerts_repeat_tolerance",
"ClusterSettingsInfo": {
"property_name": "alerts_repeat_tolerance"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/enable_external_ranger",
"ClusterSettingsInfo": {
"property_name": "enable_external_ranger"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/fetch_nonlocal_groups",
"ClusterSettingsInfo": {
"property_name": "fetch_nonlocal_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/hide_yarn_memory_widget",
"ClusterSettingsInfo": {
"property_name": "hide_yarn_memory_widget"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_bad_mounts",
"ClusterSettingsInfo": {
"property_name": "ignore_bad_mounts"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_groupsusers_create",
"ClusterSettingsInfo": {
"property_name": "ignore_groupsusers_create"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/kerberos_domain",
"ClusterSettingsInfo": {
"property_name": "kerberos_domain"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_dirs_on_root",
"ClusterSettingsInfo": {
"property_name": "manage_dirs_on_root"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_hive_fsroot",
"ClusterSettingsInfo": {
"property_name": "manage_hive_fsroot"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/managed_hdfs_resource_property_names",
"ClusterSettingsInfo": {
"property_name": "managed_hdfs_resource_property_names"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_safemode_exit_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_safemode_exit_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/one_dir_per_partition",
"ClusterSettingsInfo": {
"property_name": "one_dir_per_partition"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/override_uid",
"ClusterSettingsInfo": {
"property_name": "override_uid"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_enabled",
"ClusterSettingsInfo": {
"property_name": "recovery_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_lifetime_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_lifetime_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_retry_interval",
"ClusterSettingsInfo": {
"property_name": "recovery_retry_interval"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_type",
"ClusterSettingsInfo": {
"property_name": "recovery_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_window_in_minutes",
"ClusterSettingsInfo": {
"property_name": "recovery_window_in_minutes"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_suse_rhel_template",
"ClusterSettingsInfo": {
"property_name": "repo_suse_rhel_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_ubuntu_template",
"ClusterSettingsInfo": {
"property_name": "repo_ubuntu_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/security_enabled",
"ClusterSettingsInfo": {
"property_name": "security_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/service_check_type",
"ClusterSettingsInfo": {
"property_name": "service_check_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser",
"ClusterSettingsInfo": {
"property_name": "smokeuser"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser_keytab",
"ClusterSettingsInfo": {
"property_name": "smokeuser_keytab"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_fast_jar_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_fast_jar_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_oozie_share_lib_to_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_oozie_share_lib_to_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_tarballs_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_tarballs_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_create_users_and_groups",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_create_users_and_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_setup_jce",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_setup_jce"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/user_group",
"ClusterSettingsInfo": {
"property_name": "user_group"
}
}
]
}
{code}


*Get specific cluster-setting*

{code:title=http://<host>:<port>/api/v1/cluster_settings/agent_mounts_ignore_list}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"final": "false",
"property_depends_on": [],
"property_description": "Comma separated list of the mounts which would be ignored by Ambari
during property values suggestion by Stack Advisor",
"property_name": "agent_mounts_ignore_list",
"property_type": [],
"property_value": "",
"property_value_attributes": {
"visible": true,
"keyStore": false,
"empty_value_valid": true
},
"type": "cluster-settings.xml"
}
}
{code}

*Get specific non-existing cluster-setting*

{code:title=http://<host>:<port>/api/v1/cluster_settings/non-existing-setting}
{
"status": 404,
"message": "The requested resource doesn't exist: non-existing-setting, in cluster-settings.xml"
}
{code}


was (Author: swapanshridhar):
*API testing*

*Get all cluster-settings :*

{code:title=http://<host>:<port>/api/v1/cluster_settings/}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/",
"items": [
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"property_name": "agent_mounts_ignore_list"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/alerts_repeat_tolerance",
"ClusterSettingsInfo": {
"property_name": "alerts_repeat_tolerance"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/enable_external_ranger",
"ClusterSettingsInfo": {
"property_name": "enable_external_ranger"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/fetch_nonlocal_groups",
"ClusterSettingsInfo": {
"property_name": "fetch_nonlocal_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/hide_yarn_memory_widget",
"ClusterSettingsInfo": {
"property_name": "hide_yarn_memory_widget"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_bad_mounts",
"ClusterSettingsInfo": {
"property_name": "ignore_bad_mounts"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/ignore_groupsusers_create",
"ClusterSettingsInfo": {
"property_name": "ignore_groupsusers_create"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/kerberos_domain",
"ClusterSettingsInfo": {
"property_name": "kerberos_domain"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_dirs_on_root",
"ClusterSettingsInfo": {
"property_name": "manage_dirs_on_root"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/manage_hive_fsroot",
"ClusterSettingsInfo": {
"property_name": "manage_hive_fsroot"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/managed_hdfs_resource_property_names",
"ClusterSettingsInfo": {
"property_name": "managed_hdfs_resource_property_names"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_safemode_exit_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_safemode_exit_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/namenode_rolling_restart_timeout",
"ClusterSettingsInfo": {
"property_name": "namenode_rolling_restart_timeout"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/one_dir_per_partition",
"ClusterSettingsInfo": {
"property_name": "one_dir_per_partition"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/override_uid",
"ClusterSettingsInfo": {
"property_name": "override_uid"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_enabled",
"ClusterSettingsInfo": {
"property_name": "recovery_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_lifetime_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_lifetime_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_max_count",
"ClusterSettingsInfo": {
"property_name": "recovery_max_count"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_retry_interval",
"ClusterSettingsInfo": {
"property_name": "recovery_retry_interval"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_type",
"ClusterSettingsInfo": {
"property_name": "recovery_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/recovery_window_in_minutes",
"ClusterSettingsInfo": {
"property_name": "recovery_window_in_minutes"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_suse_rhel_template",
"ClusterSettingsInfo": {
"property_name": "repo_suse_rhel_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/repo_ubuntu_template",
"ClusterSettingsInfo": {
"property_name": "repo_ubuntu_template"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/security_enabled",
"ClusterSettingsInfo": {
"property_name": "security_enabled"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/service_check_type",
"ClusterSettingsInfo": {
"property_name": "service_check_type"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser",
"ClusterSettingsInfo": {
"property_name": "smokeuser"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/smokeuser_keytab",
"ClusterSettingsInfo": {
"property_name": "smokeuser_keytab"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_fast_jar_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_fast_jar_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_oozie_share_lib_to_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_oozie_share_lib_to_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_copy_tarballs_hdfs",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_copy_tarballs_hdfs"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_create_users_and_groups",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_create_users_and_groups"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/sysprep_skip_setup_jce",
"ClusterSettingsInfo": {
"property_name": "sysprep_skip_setup_jce"
}
},
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/user_group",
"ClusterSettingsInfo": {
"property_name": "user_group"
}
}
]
}
{code}


*Get specific cluster-setting*

{code:title=http://<host>:<port>/api/v1/cluster_settings/agent_mounts_ignore_list}
{
"href": "http://172.22.102.6:8080/api/v1/cluster_settings/agent_mounts_ignore_list",
"ClusterSettingsInfo": {
"final": "false",
"property_depends_on": [],
"property_description": "Comma separated list of the mounts which would be ignored by Ambari
during property values suggestion by Stack Advisor",
"property_name": "agent_mounts_ignore_list",
"property_type": [],
"property_value": "",
"property_value_attributes": {
"visible": true,
"keyStore": false,
"empty_value_valid": true
},
"type": "cluster-settings.xml"
}
}
{code}

*Get specific non-existing cluster-setting*

{code:title=http://172.22.102.6:8080/api/v1/cluster_settings/non-existing-setting}
{
"status": 404,
"message": "The requested resource doesn't exist: non-existing-setting, in cluster-settings.xml"
}
{code}

> Refactor non-stack cluster-env configs to cluster settings
> ----------------------------------------------------------
>
>                 Key: AMBARI-22196
>                 URL: https://issues.apache.org/jira/browse/AMBARI-22196
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.5.2
>            Reporter: Swapan Shridhar
>            Assignee: Swapan Shridhar
>            Priority: Critical
>             Fix For: trunk, 3.0.0
>
>
> *Following to be done as part of this JIRA:*
> - Move all non-stack specific configs in *cluster-env.xml* to *cluster-settings.xml*
> - For example {{cluster-env/security_enabled}} is a cluster setting and shouldn't be
associated with any stack/mpack. 
> {code}
>   <property>
>     <name>security_enabled</name>
>     <value>false</value>
>     <description>Hadoop Security</description>
>     <on-ambari-upgrade add="true"/>
>   </property>
> {code}
> - Add new file as : {{/var/lib/ambari-server/resources/cluster-settings.xml}} which includes
all the read only cluster specific settings.
> *New API Endpoint serving the cluster-settings* : api/v1/cluster_settings
> *Followup work :*
> - AMBARI-22197 takes care of removing cluster-env.xml and associated code and API once
we have AMBARI-22198 completed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message