hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Richard Jones ...@last.fm>
Subject Re: Is HDFS suited to large numbers of small files with random access?
Date Tue, 11 Jul 2006 11:42:23 GMT
You might like to try MogileFS

http://www.danga.com/mogilefs/

On Tuesday 16 May 2006 18:38, Manuel Simoni wrote:
> Hi,
>
> I am looking for a distributed file system for large numbers of small
> files (a few KB each). Maybe the files would be rows in HDFS.
>
> But my access patterns are different from MapRed-style jobs: reading and
> writing files rather randomly instead of sequential processing.
>
> Is HDFS suited to this kind of workload?
>
> Thanks,
> Manuel

-- 
Richard Jones
Last.fm Ltd. | http://www.last.fm/
Office: +44 (0) 207 7780 7080
Mobile: +44 (0) 7740 194 389

Mime
View raw message