crunch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Ortiz <dpo5...@gmail.com>
Subject Output Sizing
Date Mon, 26 Jan 2015 21:15:40 GMT
Hello,

     Is there any way to control output sizing on the crunch pipeline's
write method?  I am processing data which is written to s3 for a program
which cannot handle more than 10-20 MB per file, and am at a loss for how
to do this without writing a hive script to process the data.

Thanks,
     David Ortiz

Mime
View raw message