beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reuven Lax (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2305) Dinstinct transform produces unexpected output when triggered
Date Tue, 16 May 2017 18:43:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16012901#comment-16012901
] 

Reuven Lax commented on BEAM-2305:
----------------------------------

On second thought, I think this is working as intended though confusing. Each pane produces
the set of distinct values "so far," which is exactly what accumulating mode does.

However this is confusing, and often not what users want. I think we should add a distinctAcrossPanes
option, that would deduplicate across panes.

> Dinstinct transform produces unexpected output when triggered
> -------------------------------------------------------------
>
>                 Key: BEAM-2305
>                 URL: https://issues.apache.org/jira/browse/BEAM-2305
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-core
>            Reporter: Reuven Lax
>            Assignee: Reuven Lax
>
> Distinct is expected to produce one unique element per window (if the aggregation mode
is accumulatingFiredPanes), however the current implementation will produce one unique element
per pane instead. This is incorrect behavior.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message