beam-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Leonardo Biagioli <lbiagi...@bitbang.com>
Subject Re: Read from a Google Sheet based BigQuery table - Python SDK
Date Tue, 05 Jun 2018 17:16:35 GMT
Hi Cham,
Thank you for taking time to answer!
Is there a way to authenticate properly a Beam job on Dataflow runner? I should specify the
required scope to read from Sheets, but where I can set that parameter?
Regards,
Leonardo

Il 05 giu 2018 18:28, Chamikara Jayalath <chamikara@google.com> ha scritto:
I don't think BQ federated tables support export jobs so reading directly from such tables
likely will not work. But reading using a query should work if your job is authenticated properly
 (I haven't tested this).

- Cham


On Tue, Jun 5, 2018, 5:56 AM Leonardo Biagioli <lbiagioli@bitbang.com<mailto:lbiagioli@bitbang.com>>
wrote:

Hi guys,

just wanted to ask you if there is a chance to read from a Sheet based BigQuery table from
a Beam pipeline running on Dataflow…

I usually specify additional scopes to use through the authentication when running simple
Python code to do the same, but I wasn’t able to find a reference to something similar for
Beam.

Could you please help?

Thank you very much!

Leonardo

Mime
View raw message