avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zheng Shao <zsh...@gmail.com>
Subject lazy deserialization?
Date Sat, 23 Jan 2010 02:20:48 GMT
I noticed that avro has the "skip" functions which can help skip a
field when deserializing data.
This is good for column pruning in most cases, but we might be able to
do better in the following case.


Let's say we have a query like this:

CREATE TABLE t (col1 STRING, col2 STRING, col3 STRING);
SELECT col2 FROM t WHERE col3 = 'abcde';

We want to get field col3 first, if that matches what we want, then we
want to get to field col2.


Is there anyway to "remember" the current location of deserialization,
so that we can "resume" from that point?


-- 
Yours,
Zheng

Mime
View raw message