tez-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "junbiao chen (Jira)" <j...@apache.org>
Subject [jira] [Updated] (TEZ-4315) There is potential risk of ConcurrentModificationException when assigning pending task to container
Date Thu, 24 Jun 2021 08:43:00 GMT

     [ https://issues.apache.org/jira/browse/TEZ-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

junbiao chen updated TEZ-4315:
------------------------------
    Summary: There is potential risk of ConcurrentModificationException when assigning pending
task to container  (was: There is potential risk of ConcurrentModificationException when scheduling
task for container)

> There is potential risk of ConcurrentModificationException when assigning pending task
to container
> ---------------------------------------------------------------------------------------------------
>
>                 Key: TEZ-4315
>                 URL: https://issues.apache.org/jira/browse/TEZ-4315
>             Project: Apache Tez
>          Issue Type: Improvement
>    Affects Versions: 0.9.1, 0.10.0
>            Reporter: junbiao chen
>            Priority: Major
>
> When assigning task to container,YarnTaskSchedulerService need to traverse pending  cookieContainerRequests(stored
in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority.
In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest
from LinkedHashSet by calling method
> removeTaskRequest.This may cause ConcurrentModificationException,because  LinkedHashSet
is not thread-safe.
>  
> [https://github.com/apache/tez/pull/133]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message