beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Chambers (JIRA)" <>
Subject [jira] [Commented] (BEAM-1126) Expose UnboundedSource split backlog in number of events
Date Thu, 15 Dec 2016 00:14:59 GMT


Ben Chambers commented on BEAM-1126:

The majority of the work is getting Metrics supported well-enough to start removing Aggregators
and moving code/examples/documentation towards Metrics. This work (for Java) is tracked in
this issue

I'm working on the Dataflow runner changes right now. The other runners could choose to implement
Metrics either in a way similar to how they currently support Aggregators (providing the "committed"
value across work that succeeded) or using their own Metrics mechanisms (providing an "attempted"
value across all attempts at work).

> Expose UnboundedSource split backlog in number of events
> --------------------------------------------------------
>                 Key: BEAM-1126
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Aviem Zur
>            Assignee: Daniel Halperin
>            Priority: Minor
> Today {{UnboundedSource}} exposes split backlog in bytes via {{getSplitBacklogBytes()}}
> There is value in exposing backlog in number of events as well, since this number can
be more human comprehensible than bytes. something like {{getSplitBacklogEvents()}} or {{getSplitBacklogCount()}}.

This message was sent by Atlassian JIRA

View raw message