avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Cooper (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-957) Added Codec Support to Avro-C
Date Mon, 12 Dec 2011 06:56:30 GMT

    [ https://issues.apache.org/jira/browse/AVRO-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167376#comment-13167376

Michael Cooper commented on AVRO-957:

More work:
* Decoding of blocks now has no hardcoded buffer size. It now grows the buffer until it can
decode the whole block, then keeps reusing that block size.
* Fixed errors in the cmake configuration (the cache caught me out).
> Added Codec Support to Avro-C
> -----------------------------
>                 Key: AVRO-957
>                 URL: https://issues.apache.org/jira/browse/AVRO-957
>             Project: Avro
>          Issue Type: New Feature
>          Components: c
>            Reporter: Lucas Martin-King
>              Labels: c, codec, deflate
> We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with
preliminary deflate/inflate support (as well as null codec support).
> This changes the way blocks are written to the file, with the block data being passed
through the codec interface, before being written to file.
> This also changes the way blocks are read from a file, with the block data first being
read into a buffer, before being passed through the codec interface, then a memory reader
is set to the decoded data, which is read by the user calls avro_file_reader_read_value()
and avro_file_reader_read()
> Please feel free to make changes, as although I did try to emulate the coding style of
the rest of the avro c library, there may be things I've done "differently" :-)
> Code is available from Github:  https://github.com/hitwise/avro  (branch: codec-deflate)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message