arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Julien Le Dem <jul...@dremio.com>
Subject Re: Arrow sync in 10min
Date Thu, 02 Mar 2017 19:28:33 GMT
Notes:

Attendees:
- Julien (Dremio)
- Wes (TwoSigma)
- Uwe (BlueYonder) excused: Python packaging, Arrow ODBC dependent on
arrow-0.3

 Date and time support in C++ IPC:
  - need java implementation for integration tests.
  - arrow Json representation for date/time should be integer.
  - Miki Tebeka is working on this.

Dictionary encoding support:
  - TODO: follow up on https://github.com/apache/arrow/pull/334

New Fixed width binary type:
 - type would contain byteWidth
 - physical implementation similar to varbinary with no offset vector
 - Wes to propose a PR

New TensorType message:
 - Defined by:
   - buffer: offset, length
   - buffer layout
     - dimensions: list of longs
     - order (row major or column major)
     - type: fixed size type from the type enum.
 - Wes to propose a PR

Spark-Arrow integration:
 - contribution now depending on arrow-0.2
  https://issues.apache.org/jira/browse/SPARK-13534
  https://github.com/apache/spark/pull/15821
 - ready for review

On Thu, Mar 2, 2017 at 9:52 AM, Julien Le Dem <julien@dremio.com> wrote:

> at 10 am PT on google hangout:
> https://hangouts.google.com/hangouts/_/dremio.com/arrow
>
> --
> Julien
>



-- 
Julien

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message