Mailing-List: contact commits-help@beam.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@beam.apache.org
Date: Tue, 29 Aug 2017 00:15:00 +0000 (UTC)
From: "Lara Schmidt (JIRA)" <jira@apache.org>
To: commits@beam.apache.org
Message-ID: <JIRA.13098131.1503965659000.142134.1503965700041@Atlassian.JIRA>
In-Reply-To: <JIRA.13098131.1503965659000@Atlassian.JIRA>
References: <JIRA.13098131.1503965659000@Atlassian.JIRA> <JIRA.13098131.1503965659399@jira-lw-us.apache.org>
Subject: [jira] [Created] (BEAM-2817) Bigquery queries should allow options
 to run in batch mode or not
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 29 Aug 2017 00:15:09 -0000

Lara Schmidt created BEAM-2817:
----------------------------------

             Summary: Bigquery queries should allow options to run in batch mode or not
                 Key: BEAM-2817
                 URL: https://issues.apache.org/jira/browse/BEAM-2817
             Project: Beam
          Issue Type: Bug
          Components: sdk-java-gcp
    Affects Versions: 2.0.0
            Reporter: Lara Schmidt
            Assignee: Chamikara Jayalath


When bigquery read does a query it sets the mode to batch. A batch query can be very slow to schedule as it batches it with other queries. However it doesn't use batch quota which is better for some cases. However, in some cases a fast query is better (especially in timed tests). It would be a good idea to have a configuration to the bigquery source to set this per-read.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)