incubator-clerezza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Story <henry.st...@bblfish.net>
Subject Re: directory file size of a graph
Date Thu, 11 Aug 2011 12:15:41 GMT

On 11 Aug 2011, at 10:56, Henry Story wrote:

> 
> On 10 Aug 2011, at 15:59, Tsuyoshi Ito wrote:
> 
>> Hi 
>> 
>> I tried to copy a felix-cache (latest platform without additional resources in the
graphs) from one pc to another. During the copy process I realized that each graph is exactly
201,4MB on my mac. So a platform with no extra data is about 1.2GB - quite big. Each additional
graph is using also 200MB.
>> 
>> Has this to do with the update of tdb? 3-4 month ago a graph with no triples was
very small.
>> 
>> Is it possible to reduce the file size?

It looks like this is a OSX bug. On Solaris with my live version of clerezza at 
   http://foafssl.org/srv/idp
which has been running for a few days now, and which has a few graphs I get reasonable graph
sizes

$ du -h -d 2 felix-cache/bundle100       
  15K   felix-cache/bundle100/version0.0
 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
 227K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
 231K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.anjeve.de%2Ffoaf.rdf
 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
 228K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdavelevy.info%2Ffoaf.rdf
 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2F
 258K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
 227K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Ftbox.graph
 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
 228K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.w3.org%2FPeople%2FBerners-Lee%2Fcard
 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fah1
 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbigasterisk.com%2Ffoaf.rdf
 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ftest.com%2F
 4.9M   felix-cache/bundle100/data/tdb-data/graph
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
 223K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fcontent.graph
 227K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fsystem.graph
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
 227K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fconfig.graph
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2F
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
 228K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fgraph-access.graph
 608K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fweb-resources-cache.graph1312967243159
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.rdf
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
 224K   felix-cache/bundle100/data/tdb-data/mgraph/https%3A%2F%2Fbblfish.net%2Fuser%2Fadmin%2Fprofile
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.xml
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ftest.com%2F
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
 5.6M   felix-cache/bundle100/data/tdb-data/mgraph
  11M   felix-cache/bundle100/data/tdb-data
  11M   felix-cache/bundle100/data
  11M   felix-cache/bundle100

It would be interesting to compare those sizes with Sesame. 


> 
> Thanks for pointing that out. I just checked the size of bundle 100 and just on my pretty
empty test
> database that I run locally and delete every so often, it is 1.5GB!
> 
> $ du -d 2 -h felix-cache/bundle100/
> 1.5G	felix-cache/bundle100//data/tdb-data
> 1.5G	felix-cache/bundle100//data
> 16K	felix-cache/bundle100//version0.0
> 1.5G	felix-cache/bundle100/
> 
> So for the Social Web applications I am working where I would like to work with a lot
of graphs, this is not good. I'd like to know the reason for this. But it does look like a
reason to switch to Sesame otherwise...
> 
> Henry
> 
> 
>> 
>> 
>> Cheers
>> Tsuy
>> 
> 
> Social Web Architect
> http://bblfish.net/
> 

Social Web Architect
http://bblfish.net/


Mime
View raw message