livy-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saisai Shao <sai.sai.s...@gmail.com>
Subject Re: How to set driverMemory, driverCores, executorMemory using livy?
Date Wed, 06 Dec 2017 09:27:05 GMT
You should write as  *Spark configuration* like spark.xxx.

2017-12-06 16:23 GMT+08:00 kant kodali <kanth909@gmail.com>:

> Does the below code look right?
>
> new LivyClientBuilder()
>     .setURI(new URI(livyUrl))
>     .setConf("driverMemory", "4g").setConf("executorMemory", "4g").setConf("driverCores",
"4").build();
>
>
> On Wed, Dec 6, 2017 at 12:20 AM, kant kodali <kanth909@gmail.com> wrote:
>
>> Thanks much!
>>
>> On Wed, Dec 6, 2017 at 12:16 AM, Saisai Shao <sai.sai.shao@gmail.com>
>> wrote:
>>
>>> Using this API "public LivyClientBuilder setConf(String key, String
>>> value)"  to set Spark configurations you wanted.
>>>
>>> 2017-12-06 15:34 GMT+08:00 kant kodali <kanth909@gmail.com>:
>>>
>>>> Hi All,
>>>>
>>>>
>>>> I do see POST /sessions API where I can pass driverMemory, driverCores,
>>>> executorMemory as part of the request body but I am using programmatic API
>>>> to submit upload the Jar and submit my job so how do I set values
>>>> for driverMemory, driverCores, executorMemory ?
>>>>
>>>> Thanks!
>>>>
>>>>
>>>
>>
>

Mime
View raw message