hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mafish Liu" <maf...@gmail.com>
Subject Re: Small Filesizes
Date Tue, 16 Sep 2008 01:51:12 GMT
Hi,
  I'm just working on this situation you described, with millions of small
files sized around 10KB.
  My idea is to compact this files into big ones and create indexes for
them. This is a file system over file system and support append update, lazy
delete.
  May this help .

-- 
Mafish@gmail.com
Institute of Computing Technology, Chinese Academy of Sciences, Beijing.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message