beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chamikara Jayalath (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-3798) Performance tests flaky due to Dataflow transient errors
Date Thu, 29 Mar 2018 06:57:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418517#comment-16418517
] 

Chamikara Jayalath commented on BEAM-3798:
------------------------------------------

Sounds good. Closing.

> Performance tests flaky due to Dataflow transient errors
> --------------------------------------------------------
>
>                 Key: BEAM-3798
>                 URL: https://issues.apache.org/jira/browse/BEAM-3798
>             Project: Beam
>          Issue Type: Sub-task
>          Components: runner-dataflow
>            Reporter: Łukasz Gajowy
>            Assignee: Łukasz Gajowy
>            Priority: Major
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Performance tests are flaky due to transient errors that happened during data processing
(eg. SocketTimeoutException while connecting to DB). Currently exceptions that happen on Dataflow
runner but are retried successfully, fail the test regardless of the final job state (giving
a false-negative result). 
> Possible solution for batch scenarios:
> We could "rethrow" exceptions that happened due to transient errors *only* if the job
status is other than DONE.
> Possible solution for streaming scenarios:
> (don't know yet)
> [Link to discussion on dev list |https://lists.apache.org/thread.html/e480f8181913dc81d2d4cd1430557a646537473ccf29fe6390229098@%3Cdev.beam.apache.org%3E]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message