beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tobias Feldhaus (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1716) Using Instant type in TableRow should map to the right output format for TIMESTAMP in BigQuery
Date Tue, 25 Apr 2017 12:48:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982824#comment-15982824
] 

Tobias Feldhaus commented on BEAM-1716:
---------------------------------------

Example to reproduce: https://github.com/james-woods/beam_pipeline/commit/bf6d8a2e83db9913e3d4b67f0c3f6beaef1cc41c

> Using Instant type in TableRow should map to the right output format for TIMESTAMP in
BigQuery
> ----------------------------------------------------------------------------------------------
>
>                 Key: BEAM-1716
>                 URL: https://issues.apache.org/jira/browse/BEAM-1716
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>    Affects Versions: 0.5.0
>            Reporter: Tobias Feldhaus
>              Labels: newbie, starter
>             Fix For: First stable release
>
>
> When using an Instant type in a TableRow, and a TIMESTAMP field in the TableFieldSchema,
one has to convert the Instant via 
> instant.getMillis() / 1000
> to match the BigQuery TIMESTAMP that is "A positive or negative decimal number. A positive
number specifies the number of seconds since the epoch".
> In the Dataflow 1.9 SDK this conversion is done automatically.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message