crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evan McClain <aeroe...@gmail.com>
Subject Custom ReadableSource implementations that reuse a PType?
Date Thu, 14 Jan 2016 17:08:03 GMT
Hi list,

I am trying to implement a custom ReadableSource by extending
FileSourceImpl, but it doesn't look like my source is actually being
used since I am reusing AvroTypes (basically just trying to pass
through some avro getMeta() values).

It looks like cache() -> materialize() -> ptype.getDefaultFileSource()
is being used to perform the actual read (even though pipeline.read()
is being passed my custom Source).

Is there any way to do this without also implementing a custom PType?

Thanks
-- 
Evan McClain
https://keybase.io/aeroevan

Mime
View raw message