hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Anchlia <mohitanch...@gmail.com>
Subject Writing small files to one big file in hdfs
Date Tue, 21 Feb 2012 17:15:57 GMT
We have small xml files. Currently I am planning to append these small
files to one file in hdfs so that I can take advantage of splits, larger
blocks and sequential IO. What I am unsure is if it's ok to append one file
at a time to this hdfs file

Could someone suggest if this is ok? Would like to know how other do it.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message