orc-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Majeti <majeti.dee...@gmail.com>
Subject Re: ORC C++ writer code complete
Date Tue, 16 Jan 2018 16:30:40 GMT
Xiening, and Gang,

Thank you for your contributions to the much desired C++ Writer!
Owen did mention about a release with the ORC C++ writer soon. We will
keep you posted.

On Tue, Jan 16, 2018 at 1:22 AM, Xiening Dai
<xiening.dai@alibaba-inc.com> wrote:
>
> Hi all,
>
> In the last couple of months, Gang and I had been working on adding support
> for ORC C++ writer. With the commit from Gang last week, we now have a fully
> functioning ORC writer in C++. Here's a quick summary of what have been done
> -
>
> Basic output stream and buffering support
> Type writer that supports all ORC types including composite types
> Index and statistics
> RLEv1 support
> Zlib compression support
> UTs and the new CSVFileImport tool to create ORC file using C++ writer
>
> The C++ writer is not yet at feature parity with the Java writer, and we
> plan to continue improving it going forward -
>
> More efficient memory management for the writer
> Better encoding support (RLEv2 and double encoding in the future)
> More compression codec support, especially zStd
> Async prefetch support for the reader
> Predicate pushdown
>
> We'd like to invite people in this mail group to try out the new C++ writer
> and report any issues/bugs.
>
> Owen/Deepak,
>
> Thanks for your helps on code reviews and design reviews in the past. If you
> need help on shipping the writer in next ORC release, feel free to let us
> know. Thanks!



-- 
regards,
Deepak Majeti

Mime
View raw message