flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lzh9 (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-10214) why is job applying as many TMs as default parallelism when starting, each parallelism is 1
Date Sat, 25 Aug 2018 08:57:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-10214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592526#comment-16592526
] 

lzh9 commented on FLINK-10214:
------------------------------

yes, it says the legacy mode will be removed completely in the next release. but why it's
designed that one TM only support one slot in future?

> why is job applying as many TMs as default parallelism when starting, each parallelism
is 1
> -------------------------------------------------------------------------------------------
>
>                 Key: FLINK-10214
>                 URL: https://issues.apache.org/jira/browse/FLINK-10214
>             Project: Flink
>          Issue Type: Task
>          Components: Cluster Management, TaskManager, YARN
>    Affects Versions: 1.5.0
>            Reporter: lzh9
>            Priority: Major
>
> If I set TM number=6, slot num each TM=8, memory each TM=4G, the job will apply 48 TMs,
and use only one slot each, total memory usage is 192G. A few minutes later, it will release
40TMs, everything will be normal. 
> Is there any reason about it? 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message