arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <emkornfi...@gmail.com>
Subject Re: Processing GetRecordBatcheReader PyArrow - 7800
Date Fri, 19 Jun 2020 04:10:41 GMT
Hi Rollo,
This is probably better discussed on dev@arrow.apache.org.  In general, it
is up to committers to hold the bar of what they think is appropriate to
merge or not merge, so it is best to have the discussion directly with them.

Thanks,
Micah

On Fri, Jun 12, 2020 at 2:49 AM Rollo Konig-Brock <rollokb@gmail.com> wrote:

> Hey all,
>
>
>
> I started work on 7800, and have been running in a production system for a
> while now. I was a bit unclear on some API decisions, and sadly left the
> branch to go stale.
>
>
>
> Then wjones1 also had a similar requirement, and forked off trying to
> finish my work. This is also going stale.
>
>
>
> It seems like there are some really minor changes requested that I don’t
> think have any material effect, and some unclear question about the API
> design (I’ve asked wjones1 for write access to his fork of my branch).
>
>
>
> I think it’d be really great to get this in even if the API isn’t the most
> graceful thing. Right now the unpredictability memory usage can make
> PyArrow unsuitable for a great number use cases.
>
>
>
> Sincerely,
>
> Rollo
>
>
>

Mime
View raw message