commons-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lian Ort" <lian...@googlemail.com>
Subject Re: flexible byte-stream storage? [vfs] [cache] ??
Date Wed, 14 Mar 2007 07:56:12 GMT
Hello Paul,
did you check Berkeley DB (BDB;
http://www.oracle.com/database/berkeley-db/index.html) ?
Its kinda usable like a HashMap. You are looking for a solution
to store Objects as Bytestreams and to get them back via a key. This sounds
like a HashMap
and this is also one of the way Berkeley DB is usable. BDB only handles
bytestreams, no concrete
java objects. You can store any sized bytestream in it and the library is
fast.
Greetings,
Lian


On 3/14/07, Thorbjørn Ravn Andersen <thunderaxiom@gmail.com> wrote:
>
> Paul Libbrecht skrev  den 21-02-2007 21:22:
> > Thanks for the hint of a directory split in a way similar to a
> > hash-table, I hadn't thought about it and it would solve the horrible
> > 50'000 files/directory.
> > Choosing the host platform is not an option though... so the
> > filesystem also not.
>
> > Overall these 50'000 only bother if you look at it.
> >
> It may also be a performance problem, depending on whether the directory
> is searched linearly or sequentially for a named file.
> > Where I am rather making hopes is for the small-sized chunks for which
> > making a full-file is a waste on several file systems which have
> > minimal sizes of 512 bytes, and some 4Kb...
> > Of course I could write my library for this, with java.nio most
> > probably, but I was hoping VFS or some other library to help me there.
> >
> Could you elaborate on your scenario.  Perhaps the usage patterns lend
> towards a given pattern.
>
> --
>   Thorbjørn
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message