ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
Date Thu, 21 Jan 2016 23:22:39 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111590#comment-15111590
] 

Jeff Zhang commented on AMBARI-14561:
-------------------------------------

Upload addendum2 patch (spark depends on hive now from HDP 2.4, and needs to start spark-thriftserver
after hive_server)

> Configuration changes of spark thrift server for Spark 1.6
> ----------------------------------------------------------
>
>                 Key: AMBARI-14561
>                 URL: https://issues.apache.org/jira/browse/AMBARI-14561
>             Project: Ambari
>          Issue Type: Improvement
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>             Fix For: 2.2.1
>
>         Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch, Ambari-14561-addendum-2.patch,
Ambari-14561-addendum.patch, Ambari-14561-branch-2.2.patch
>
>
> This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift
server
> * Remove advanced properties except queue name
> * Use yarn-client mode 
> * Enable Dynamic Resource Allocation
> * Enable Fair scheduling policy
> * Use FileSystem as event logging destination
> * Copy spark-hdp-assembly.jar to hdfs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message