avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yael aharon <yael.aharo...@gmail.com>
Subject Re: Saving arbitrary data to avro files
Date Tue, 04 Mar 2014 18:44:11 GMT
Thank you for your reply.
If I use a string only schema, how would the reader get to know the correct
schema?


On Tue, Mar 4, 2014 at 1:08 PM, Harsh J <harsh@cloudera.com> wrote:

> You can do this, sure. You just need a schema of string type or something
> similar.
>
> Are you not concerned about the read time of the data you plan to store as
> strings? Typically you write once and read more than once during processing.
>
> Storing the data types in proper serialized form would help greatly during
> reads.
> On Mar 4, 2014 8:54 AM, "yael aharon" <yael.aharon.m@gmail.com> wrote:
>
>> Hello,
>> I am writing a C++ library that stores arbitrary data to avro files.
>> The schema is given to me through my library's API.
>> All the data is given to me in the form of strings; including integers,
>> doubles, etc.
>> Is there a way for me to store this data to avro files without converting
>> the strings to the correct types first? I am concerned about the
>> performance impact that this conversion would have
>> thanks, Yael
>>
>

Mime
View raw message