beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Work logged] (BEAM-4417) BigqueryIO Numeric datatype Support
Date Fri, 29 Jun 2018 21:38:00 GMT


ASF GitHub Bot logged work on BEAM-4417:

                Author: ASF GitHub Bot
            Created on: 29/Jun/18 21:37
            Start Date: 29/Jun/18 21:37
    Worklog Time Spent: 10m 
      Work Description: ElliottBrossard commented on issue #5755: [BEAM-4417] Support BigQuery's
NUMERIC type using Java
   I think (hope) that I fixed the conflicts. I haven't been able to figure out how to run
the integration test, though. Are there specific instructions about how to run `org.apache.beam.examples.cookbook.BigQueryTornadoesIT`?
I've read,
but I don't understand the association between Perfkit, Gradle, and Beam. I installed Gradle,
but my naive attempt at running the test fails:
       ~/beam/examples/java$ ~/gradle-4.8.1/bin/gradle test --tests=org.apache.beam.examples.cookbook.BigQueryTornadoesIT
       Execution failed for task ':beam-examples-java:test'.
       No tests found for given includes: [**/Test*.class, **/*Test.class, **/*Tests.class,
**/*TestCase.class](include rules) [org.apache.beam.examples.cookbook.BigQueryTornadoesIT](--tests
   The example indicates using the `performanceTest` task with `gradlew`, but I can't tell
where that is defined. Any pointers you can provide would be great.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 117601)
    Time Spent: 2h  (was: 1h 50m)

> BigqueryIO Numeric datatype Support
> -----------------------------------
>                 Key: BEAM-4417
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>    Affects Versions: 2.4.0
>            Reporter: Kishan Kumar
>            Assignee: Chamikara Jayalath
>            Priority: Critical
>              Labels: newbie, patch
>             Fix For: 2.6.0
>          Time Spent: 2h
>  Remaining Estimate: 0h
> The fails while parsing the data from the avro file generated while
reading the data from the table which has columns with *Numeric* datatypes. 
> We have gone through the source code at Git-Hub and noticed that *Numeric data type is
not yet supported.* 
> Caused by: Unsupported BigQuery type: NUMERIC

This message was sent by Atlassian JIRA

View raw message