beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Shields (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-175) Leak garbage collection timers in GlobalWindow
Date Tue, 05 Apr 2016 22:20:25 GMT
Mark Shields created BEAM-175:
---------------------------------

             Summary: Leak garbage collection timers in GlobalWindow
                 Key: BEAM-175
                 URL: https://issues.apache.org/jira/browse/BEAM-175
             Project: Beam
          Issue Type: Bug
          Components: runner-core
            Reporter: Mark Shields
            Assignee: Frances Perry


Consider the  transform:
  Window
    .into(new GlobalWindows())
    .triggering(
      Repeatedly.forever(
        AfterProcessingTime.pastFirstElementInPane().plusDelayOf(...)))
    .discardingFiredPanes()
This is a common idiom for 'process elements bunched by arrival time'.
Currently we create an end-of-window timer per key, which clearly will only fire if the pipeline
is drained.
Better would be to avoid creating end-of-window timers if there's no state which needs to
be processed at end-of-window (ie at drain if the Global window).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message