Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 08445200D0C for ; Wed, 6 Sep 2017 02:58:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 06FA31609D1; Wed, 6 Sep 2017 00:58:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 4BA3B1609C5 for ; Wed, 6 Sep 2017 02:58:03 +0200 (CEST) Received: (qmail 88938 invoked by uid 500); 6 Sep 2017 00:58:02 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 88928 invoked by uid 99); 6 Sep 2017 00:58:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Sep 2017 00:58:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 0EEEECB2EC for ; Wed, 6 Sep 2017 00:58:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id qYx6mlPKQsOV for ; Wed, 6 Sep 2017 00:58:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 4975F61131 for ; Wed, 6 Sep 2017 00:58:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id D36EFE0ECA for ; Wed, 6 Sep 2017 00:58:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 3EF7F24158 for ; Wed, 6 Sep 2017 00:58:00 +0000 (UTC) Date: Wed, 6 Sep 2017 00:58:00 +0000 (UTC) From: "Chamikara Jayalath (JIRA)" To: commits@beam.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (BEAM-2843) Log the reason for failure for BigQuery jobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Wed, 06 Sep 2017 00:58:04 -0000 Chamikara Jayalath created BEAM-2843: ---------------------------------------- Summary: Log the reason for failure for BigQuery jobs Key: BEAM-2843 URL: https://issues.apache.org/jira/browse/BEAM-2843 Project: Beam Issue Type: Improvement Components: sdk-java-gcp Reporter: Chamikara Jayalath Priority: Minor For BigQuery load jobs we currently retry few times and log the job ID. It might be good to get the reason for the failure from BigQuery (prob. this is available through status poll) and log that as well. For example, failed load jobs are logged at following location. https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L202 -- This message was sent by Atlassian JIRA (v6.4.14#64029)