tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "junbiao chen (Jira)" <j...@apache.org>
Subject [jira] [Updated] (TEZ-4315) There is potential risk of ConcurrentModificationException when scheduling task for container
Date Thu, 24 Jun 2021 08:33:00 GMT

     [ https://issues.apache.org/jira/browse/TEZ-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

junbiao chen updated TEZ-4315:
------------------------------
    Description: 
When assigning task to container,YarnTaskSchedulerService need to traverse pending  cookieContainerRequests(stored
in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority.
In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest
from LinkedHashSet by calling method

removeTaskRequest.This may cause ConcurrentModificationException,because  LinkedHashSet
is not thread-safe.

  was:
When assigning task to container,YarnTaskSchedulerService need to traverse pending  cookieContainerRequests(stored
in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority.
In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest
from LinkedHashSet by calling method

removeTaskRequest

.This may cause ConcurrentModificationException,because  LinkedHashSet is not thread-safe.


> There is potential risk of ConcurrentModificationException when scheduling task for container
> ---------------------------------------------------------------------------------------------
>
>                 Key: TEZ-4315
>                 URL: https://issues.apache.org/jira/browse/TEZ-4315
>             Project: Apache Tez
>          Issue Type: Improvement
>    Affects Versions: 0.9.1, 0.10.0
>            Reporter: junbiao chen
>            Priority: Major
>
> When assigning task to container,YarnTaskSchedulerService need to traverse pending  cookieContainerRequests(stored
in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority.
In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest
from LinkedHashSet by calling method
> removeTaskRequest.This may cause ConcurrentModificationException,because  LinkedHashSet
is not thread-safe.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message