beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (BEAM-4601) BigQuery reads from pure SQL
Date Fri, 29 Jun 2018 18:07:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-4601?focusedWorklogId=117515&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117515
]

ASF GitHub Bot logged work on BEAM-4601:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 29/Jun/18 18:06
            Start Date: 29/Jun/18 18:06
    Worklog Time Spent: 10m 
      Work Description: amaliujia commented on a change in pull request #5830: [BEAM-4601][SQL]
Support BigQuery read from SQL.
URL: https://github.com/apache/beam/pull/5830#discussion_r199238896
 
 

 ##########
 File path: sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/bigquery/BeamBigQueryTable.java
 ##########
 @@ -43,7 +52,30 @@ public BeamBigQueryTable(Schema beamSchema, String tableSpec) {
 
   @Override
   public PCollection<Row> buildIOReader(PBegin begin) {
-    throw new UnsupportedOperationException();
+    return begin
+        .apply(
+            BigQueryIO.read(
+                    new SerializableFunction<SchemaAndRecord, Row>() {
 
 Review comment:
   If I should wrap it into `BigQueryUtils.java`, then `AvroUtils.java` should also be in
IO component so I don't need add dependency of SQL to IO (as IO will need call AvroUtils if
not do so).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 117515)
    Time Spent: 2.5h  (was: 2h 20m)

> BigQuery reads from pure SQL
> ----------------------------
>
>                 Key: BEAM-4601
>                 URL: https://issues.apache.org/jira/browse/BEAM-4601
>             Project: Beam
>          Issue Type: New Feature
>          Components: dsl-sql
>            Reporter: Rui Wang
>            Assignee: Rui Wang
>            Priority: Major
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Right now Beam SQL can created a BigQuery table, however, read from BigQuery table is
not supported yet. We want to support reading from BigQuery table.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message