beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Chambers (JIRA)" <>
Subject [jira] [Created] (BEAM-2186) Use Accumulable MetricsContainers in the DirectRunner
Date Fri, 05 May 2017 21:14:04 GMT
Ben Chambers created BEAM-2186:

             Summary: Use Accumulable MetricsContainers in the DirectRunner
                 Key: BEAM-2186
             Project: Beam
          Issue Type: Bug
          Components: runner-direct
            Reporter: Ben Chambers
            Assignee: Thomas Groh

Once PR 2649 is submitted, we should be able to use the accumulable functionality to clean
up the DirectRunner. Since this runner updates metrics from multiple processing threads simultaneously,
we will need to figure out how to either (1) make the accumulable behavior thread safe or
(2) have a non-blocking way of performing the accumulation sequentially.

If we go with (2), we can put updated containers in a queue and then have a single thread
trying to apply those updates.

This message was sent by Atlassian JIRA

View raw message