beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Maximilian Michels (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (BEAM-5211) Flink Streaming ExecutableStage operator chain blocks grpc receiver threads
Date Fri, 24 Aug 2018 09:16:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Maximilian Michels resolved BEAM-5211.
--------------------------------------
    Resolution: Fixed

Should be fixed now via https://github.com/apache/beam/pull/6271

> Flink Streaming ExecutableStage operator chain blocks grpc receiver threads 
> ----------------------------------------------------------------------------
>
>                 Key: BEAM-5211
>                 URL: https://issues.apache.org/jira/browse/BEAM-5211
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>    Affects Versions: 2.6.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Major
>              Labels: portability
>             Fix For: 2.7.0
>
>         Attachments: jstack.log
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> The operator attempts to emit results as they are received, within the grpc thread, while
the subtask thread is waiting for bundle completion. This leads to blocking of grpc threads
and eventually deadlock when multiple stages are within an operator chain. Observed with wordcount,
see attached stacktrace.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message