commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thorbjørn Ravn Andersen <>
Subject Re: flexible byte-stream storage? [vfs] [cache] ??
Date Wed, 14 Mar 2007 00:21:56 GMT
Paul Libbrecht skrev  den 21-02-2007 21:22:
> Thanks for the hint of a directory split in a way similar to a 
> hash-table, I hadn't thought about it and it would solve the horrible 
> 50'000 files/directory.
> Choosing the host platform is not an option though... so the 
> filesystem also not.

> Overall these 50'000 only bother if you look at it.
It may also be a performance problem, depending on whether the directory 
is searched linearly or sequentially for a named file.
> Where I am rather making hopes is for the small-sized chunks for which 
> making a full-file is a waste on several file systems which have 
> minimal sizes of 512 bytes, and some 4Kb...
> Of course I could write my library for this, with java.nio most 
> probably, but I was hoping VFS or some other library to help me there.
Could you elaborate on your scenario.  Perhaps the usage patterns lend 
towards a given pattern.


View raw message