beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chamikara Jayalath (JIRA)" <j...@apache.org>
Subject [jira] [Created] (BEAM-2843) Log the reason for failure for BigQuery jobs
Date Wed, 06 Sep 2017 00:58:00 GMT
Chamikara Jayalath created BEAM-2843:
----------------------------------------

             Summary: Log the reason for failure for BigQuery jobs
                 Key: BEAM-2843
                 URL: https://issues.apache.org/jira/browse/BEAM-2843
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-gcp
            Reporter: Chamikara Jayalath
            Priority: Minor


For BigQuery load jobs we currently retry few times and log the job ID.

It might be good to get the reason for the failure from BigQuery (prob. this is available
through status poll) and log that as well. For example, failed load jobs are logged at following
location.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L202





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message