beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1126) Expose UnboundedSource split backlog in number of events
Date Tue, 13 Dec 2016 14:14:58 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15745258#comment-15745258
] 

Daniel Halperin commented on BEAM-1126:
---------------------------------------

If UnboundedSource supported aggregators/metrics today, would you still want this change?

(Assuming the answer is no:)

I don't like the idea of complicating core APIs solely as a short term workaround for the
issue that metrics aren't supported everywhere. We are actively trying to fix metrics to be
usable in more places; it seems a better long-term solution to wait for [or help with!] that
effort.

(Assuming the answer is yes:)

Say more?

> Expose UnboundedSource split backlog in number of events
> --------------------------------------------------------
>
>                 Key: BEAM-1126
>                 URL: https://issues.apache.org/jira/browse/BEAM-1126
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Aviem Zur
>            Assignee: Daniel Halperin
>            Priority: Minor
>
> Today {{UnboundedSource}} exposes split backlog in bytes via {{getSplitBacklogBytes()}}
> There is value in exposing backlog in number of events as well, since this number can
be more human comprehensible than bytes. something like {{getSplitBacklogEvents()}} or {{getSplitBacklogCount()}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message