avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arvind Kalyan <bas...@gmail.com>
Subject Re: Doubt in a AVRO scenario
Date Wed, 11 Feb 2015 07:05:40 GMT
Schema is not stored along with data. You either need to store it as part
of the data (hbase value: schema_id + avrodata; and map schema_id to a
schema somehow in your own code) if you have different schema for different
rows/cells, or you can keep the schema separately for the whole hbase db if
all rows are expected to have the same schema.

On Tue, Feb 10, 2015 at 10:48 PM, Arunasalam G <zealousarun@gmail.com>

> Hi,
> I am new to AVRO and have a doubt in a scenario. Kindly requesting you to
> help me on this.
>     1. An AVRO object is constructed and is serialized and stored as value
> in HBASE table.
>     2. While retrieving it, we are retrieving the stored Byte Array value.
> Is it possible to retrieve the schema directly from the Byte Array value
> just like we retrieve schema from a file?
> Because we don't want to initialize the DatumReader object with schema
> initialized.
> I find that AVRO supports retrieving a schema from an AVRO file using
> DataFileReader wherein, the schema can be obtained from the avro file and
> hence, DatumReader can be initialized without schema.
> But in our case, we needed to initialize the Reader without schema and
> hence, is there any way to retrieve the schema stored in a serialized byte
> array object?
> I would be really greatful if you take a look at the following scenario.
> Thanks in advance.
> Regards,
> Arun G

Arvind Kalyan
cell: (408) 761-2030

View raw message