avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Cooper (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AVRO-957) Added Codec Support to Avro-C
Date Tue, 13 Dec 2011 04:29:30 GMT

     [ https://issues.apache.org/jira/browse/AVRO-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Michael Cooper updated AVRO-957:
--------------------------------

    Description: 
We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary
deflate/inflate support (as well as null codec support).

This changes the way blocks are written to the file, with the block data being passed through
the codec interface, before being written to file.

This also changes the way blocks are read from a file, with the block data first being read
into a buffer, before being passed through the codec interface, then a memory reader is set
to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()

Please feel free to make changes, as although I did try to emulate the coding style of the
rest of the avro c library, there may be things I've done "differently" :-)

Code is available from Github:  https://github.com/hitwise/avro  (branch: codec)

  was:
We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with preliminary
deflate/inflate support (as well as null codec support).

This changes the way blocks are written to the file, with the block data being passed through
the codec interface, before being written to file.

This also changes the way blocks are read from a file, with the block data first being read
into a buffer, before being passed through the codec interface, then a memory reader is set
to the decoded data, which is read by the user calls avro_file_reader_read_value() and avro_file_reader_read()

Please feel free to make changes, as although I did try to emulate the coding style of the
rest of the avro c library, there may be things I've done "differently" :-)

Code is available from Github:  https://github.com/hitwise/avro  (branch: codec-deflate)

    
> Added Codec Support to Avro-C
> -----------------------------
>
>                 Key: AVRO-957
>                 URL: https://issues.apache.org/jira/browse/AVRO-957
>             Project: Avro
>          Issue Type: New Feature
>          Components: c
>            Reporter: Lucas Martin-King
>              Labels: c, codec, deflate
>
> We (Experian Hitwise) have added codec support to avro-c (as per the avro spec), with
preliminary deflate/inflate support (as well as null codec support).
> This changes the way blocks are written to the file, with the block data being passed
through the codec interface, before being written to file.
> This also changes the way blocks are read from a file, with the block data first being
read into a buffer, before being passed through the codec interface, then a memory reader
is set to the decoded data, which is read by the user calls avro_file_reader_read_value()
and avro_file_reader_read()
> Please feel free to make changes, as although I did try to emulate the coding style of
the rest of the avro c library, there may be things I've done "differently" :-)
> Code is available from Github:  https://github.com/hitwise/avro  (branch: codec)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message