beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2817) Bigquery queries should allow options to run in batch mode or not
Date Thu, 07 Dec 2017 08:10:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281482#comment-16281482
] 

ASF GitHub Bot commented on BEAM-2817:
--------------------------------------

justintumale closed pull request #4118: [BEAM-2817] BigQuery queries are allowed to run in
either BATCH or INTERACTIVE mode
URL: https://github.com/apache/beam/pull/4118
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Bigquery queries should allow options to run in batch mode or not
> -----------------------------------------------------------------
>
>                 Key: BEAM-2817
>                 URL: https://issues.apache.org/jira/browse/BEAM-2817
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>    Affects Versions: 2.0.0
>            Reporter: Lara Schmidt
>            Assignee: Justin Tumale
>              Labels: newbie, starter
>
> When bigquery read does a query it sets the mode to batch. A batch query can be very
slow to schedule as it batches it with other queries. However it doesn't use batch quota which
is better for some cases. However, in some cases a fast query is better (especially in timed
tests). It would be a good idea to have a configuration to the bigquery source to set this
per-read.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message