arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Julien Le Dem <jul...@dremio.com>
Subject Re: Arrow sync starting now
Date Thu, 16 Feb 2017 18:59:52 GMT
notes:

Attendees
- Khaled (PhD student Waterloo): distributed graph processing. Use arrow
for distributed graph database in C++.
Interested in Kudu, Arrow.
- Wes (Two Sigma): arrow website update, Tensor type
- Uwe (Blue Yonder): push release, update arrow website
- Julien (Dremio): arrow roadmap

Arrow website
- Arrow website is updated automatically from svn.
- Uwe: look at the same setup as Calcite. site source in git. tool to push
to svn

Arrow road map
- Need to write down a road map
 - arrow UDF interface (spark/python java)
 - arrow storage interface (kudu…)
 - Uwe: arrow ODBC connector (on top of arrow). See:
https://github.com/blue-yonder/turbodbc

- Tensor type: https://issues.apache.org/jira/browse/ARROW-550
  - n-dimensional metadata with direction (fortran-order: column major,
c-order: rows contiguous. dimensions change in reverse order)
Needed for Ion Stoica’s Ray project: https://github.com/ray-project/ray

- Wes: possibly move python code under cpp folder to facilitate
development.

- Arrow 0.3 goals:
 - complete dictionary IPC
 - tensor types: initially no support for large buffers in java
 - Uwe: dictionary in arrow <- parquet.
 - Julien: java vectors bug fixes.


On Thu, Feb 16, 2017 at 10:04 AM, Julien Le Dem <julien@dremio.com> wrote:

> https://hangouts.google.com/hangouts/_/dremio.com/arrow
>
> --
> Julien
>



-- 
Julien

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message