beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ni...@apache.org
Subject [beam] branch master updated: Change filter to also retry on 408 errors.
Date Fri, 20 Aug 2021 21:41:20 GMT
This is an automated email from the ASF dual-hosted git repository.

ningk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
     new cc2a07b  Change filter to also retry on 408 errors.
     new 5563e46  Merge pull request #15367 from ryanthompson591/retry_on_408
cc2a07b is described below

commit cc2a07bba752fa85b6273adcd22484ac0247c3e7
Author: Ryan Thompson <ryanthompson591@gmail.com>
AuthorDate: Fri Aug 20 16:49:58 2021 -0400

    Change filter to also retry on 408 errors.
---
 sdks/python/apache_beam/runners/dataflow/internal/apiclient.py | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py b/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
index 9dc75cf..0265629 100644
--- a/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
+++ b/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py
@@ -550,7 +550,8 @@ class DataflowApplicationClient(object):
         dict(s.split(',', 1)
              for s in sdk_overrides) if sdk_overrides else dict())
 
-  @retry.with_exponential_backoff()  # Use filter defaults.
+  @retry.with_exponential_backoff(
+      retry_filter=retry.retry_on_server_errors_and_timeout_filter)
   def _gcs_file_copy(self, from_path, to_path):
     to_folder, to_name = os.path.split(to_path)
     total_size = os.path.getsize(from_path)

Mime
View raw message