avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nishanth S <chinchu2...@gmail.com>
Subject LazyOutputFormat with AvroMultipleOutputs
Date Thu, 10 Sep 2015 22:14:09 GMT
Hello All,
We are using avro 1.7.7 and the  map reduce program we have writes  to
multiple avro output files.I  am using lazy out fomat in the driver but I
could still see empty avro files getting created if there is no data.We
have a hive table that points to this location and when  these avro files
are  empty hive queries fail on read.Is there a way to avoid writing empty
avro files when no data is  present or is there is a way  to set a property
in hive so  that these files are ignored?.Thanks for your help.


View raw message