arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Le Dem (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-315) Finalize timestamp field
Date Mon, 03 Oct 2016 22:23:21 GMT
Julien Le Dem created ARROW-315:
-----------------------------------

             Summary: Finalize timestamp field
                 Key: ARROW-315
                 URL: https://issues.apache.org/jira/browse/ARROW-315
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Format
            Reporter: Julien Le Dem
            Assignee: Julien Le Dem


support int64 UNIX timestamps with a particular resolution.

Parquet supports timestamp millis and micros (no nanos)
https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#datetime-types

currently Arrow timestamps have a timezone field. 
https://github.com/apache/arrow/blob/master/format/Message.fbs#L67
proposal to change timestamp as follows:
- remove "timestamp" field and say it's UTC
- add unit field (MICROS | MILLIS)






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message