avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Saving arbitrary data to avro files
Date Tue, 04 Mar 2014 18:08:33 GMT
You can do this, sure. You just need a schema of string type or something
similar.

Are you not concerned about the read time of the data you plan to store as
strings? Typically you write once and read more than once during processing.

Storing the data types in proper serialized form would help greatly during
reads.
On Mar 4, 2014 8:54 AM, "yael aharon" <yael.aharon.m@gmail.com> wrote:

> Hello,
> I am writing a C++ library that stores arbitrary data to avro files.
> The schema is given to me through my library's API.
> All the data is given to me in the form of strings; including integers,
> doubles, etc.
> Is there a way for me to store this data to avro files without converting
> the strings to the correct types first? I am concerned about the
> performance impact that this conversion would have
> thanks, Yael
>

Mime
View raw message