avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Clément MATHIEU <clem...@unportant.info>
Subject Re: Need Help
Date Tue, 12 Jan 2016 10:59:27 GMT
On 2016-01-12 07:15, Dhaval Patel wrote:

Hi Dhaval,


> I am using Hive with avro serialisation. Applying some business rules
> on data using crunch and store processed data to .avro. Now user want
> that data in flat file. So I need to export to local.

Since you are using Crunch, you could also run your pipeline, then 
materialize() the PCollection in the driver and iterate over the records 
to create your "flat file".

You can even skip the creation of the avro file if you only can about 
the "local flat file".

Clément

Mime
View raw message