ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
Date Thu, 07 Jan 2016 12:20:40 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087284#comment-15087284
] 

Jeff Zhang commented on AMBARI-14561:
-------------------------------------

Attach another patch for HDP 2.4. But the weird thing is that the configuration in HDP 2.3's
spark-thrift-sparkconf.xml will be appended to HDP-2.4's spark-thrift-sparkconf.xml. And what
I want is remove some configuration in 2.3. And actually I make Spark 1.6 of HDP 2.4 extend
Spark 1.2 in common-services, not sure why it still use spark-thrift-sparkconf.xml in HDP
2.3

> Configuration changes of spark thrift server for Spark 1.6
> ----------------------------------------------------------
>
>                 Key: AMBARI-14561
>                 URL: https://issues.apache.org/jira/browse/AMBARI-14561
>             Project: Ambari
>          Issue Type: Improvement
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>         Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch
>
>
> This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift
server
> * Remove advanced properties except queue name
> * Use yarn-client mode 
> * Enable Dynamic Resource Allocation
> * Enable Fair scheduling policy



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message