avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishanth S <nishanth.2...@gmail.com>
Subject Using Avro Append Functionality
Date Sun, 08 Jan 2017 15:54:42 GMT
Hello All,

We are currently using a  stand alone java program to  convert a small set
of binary files to avro format and then store in hdfs.I would like to
create one single avro file for a day (1GB approximatley) .I was thinking
of using the FsInput provided in avro  to achieve the append functionality
.How  will this perform when compared to other options like avro-tools
concat after the files are created?Any pointers as to which one would
perform better?.

Thanks,
Nishanth

Mime
View raw message