beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismaël Mejía (JIRA) <j...@apache.org>
Subject [jira] [Created] (BEAM-2409) Spark runner produces exactly twice the number of results in streaming mode when use triggers to re-window results on global window.
Date Mon, 05 Jun 2017 14:28:04 GMT
Ismaël Mejía created BEAM-2409:
----------------------------------

             Summary: Spark runner produces exactly twice the number of results in streaming
mode when use triggers to re-window results on global window.
                 Key: BEAM-2409
                 URL: https://issues.apache.org/jira/browse/BEAM-2409
             Project: Beam
          Issue Type: Bug
          Components: runner-spark
    Affects Versions: 2.0.0
            Reporter: Ismaël Mejía
            Assignee: Aviem Zur


This can be tested with Nexmark query 6. Sorry I don’t have a smaller test case than this,
but I think the part of the pipeline that produces the result is this one.

{code:java}
        .apply(
            Window.<KV<Long, Bid>>into(new GlobalWindows())
                .triggering(Repeatedly.forever(AfterPane.elementCountAtLeast(1)))
                .accumulatingFiredPanes()
                .withAllowedLateness(Duration.ZERO))
{code}





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message