beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Kirpichov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner
Date Mon, 07 Aug 2017 22:43:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117469#comment-16117469
] 

Eugene Kirpichov commented on BEAM-2671:
----------------------------------------

Aviem - my apologies for misunderstanding previous comments on the JIRA. Could you elaborate
on "If we want streaming to be working in Spark runner in 2.1.0 we should fix this for 2.1.0"
- I'd like to understand to what extent is Spark runner streaming currently broken in 2.1.0,
given that it passes the other SDK ValidatesRunner tests. Are those tests insufficient / should
we have more coverage there?

Has anybody run any serious Spark streaming pipelines on a cluster against 2.1.0 RC2? JB -
I believe you said you did; can you detail what kind of pipeline you ran, and does it potentially
address Aviem's concerns?

> CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner
> --------------------------------------------------------------------------------
>
>                 Key: BEAM-2671
>                 URL: https://issues.apache.org/jira/browse/BEAM-2671
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Etienne Chauchot
>            Assignee: Jean-Baptiste Onofré
>             Fix For: 2.1.0
>
>
> Error message:
> Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0: 
> Expected: iterable over [] in any order
>      but: Not matched: "late"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message