beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (BEAM-1235) BigQueryIO doesn't show the load job error to the user
Date Fri, 27 Jan 2017 03:09:24 GMT

     [ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Halperin resolved BEAM-1235.
-----------------------------------
    Resolution: Fixed

> BigQueryIO doesn't show the load job error to the user
> ------------------------------------------------------
>
>                 Key: BEAM-1235
>                 URL: https://issues.apache.org/jira/browse/BEAM-1235
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>            Reporter: Eugene Kirpichov
>            Assignee: Pei He
>             Fix For: 0.5.0
>
>
> When a BigQuery load job fails, we only say that it failed, but don't show the error
message.
> https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339
doesn't put the jobStatus in the exception, and https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332
doesn't even log it.
> User who hit the issue: http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk
(though this is using the Dataflow SDK so it'll need to be backported from Beam to Dataflow,
or the user will need to use Beam once the issue is fixed)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message