incubator-clerezza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi Ito <tsuy....@trialox.org>
Subject Re: directory file size of a graph
Date Thu, 11 Aug 2011 13:46:42 GMT
Hi Henry

I think it is not a OS X bug. I have the same issue on my ubuntu. BTW Reto is also working
on a linux distribution.

I am pretty sure that few months ago the graphs were very small when launching the platform
the first time.

IMO our sesame provider is not an alternative because it is extremely slow compared to tdb.
that's why trialox has changed the default provider to tdb in 2009.

Cheers
Tsuy

On Aug 11, 2011, at 2:15 PM, Henry Story wrote:

> 
> On 11 Aug 2011, at 10:56, Henry Story wrote:
> 
>> 
>> On 10 Aug 2011, at 15:59, Tsuyoshi Ito wrote:
>> 
>>> Hi 
>>> 
>>> I tried to copy a felix-cache (latest platform without additional resources in
the graphs) from one pc to another. During the copy process I realized that each graph is
exactly 201,4MB on my mac. So a platform with no extra data is about 1.2GB - quite big. Each
additional graph is using also 200MB.
>>> 
>>> Has this to do with the update of tdb? 3-4 month ago a graph with no triples
was very small.
>>> 
>>> Is it possible to reduce the file size?
> 
> It looks like this is a OSX bug. On Solaris with my live version of clerezza at 
>   http://foafssl.org/srv/idp
> which has been running for a few days now, and which has a few graphs I get reasonable
graph sizes
> 
> $ du -h -d 2 felix-cache/bundle100       
>  15K   felix-cache/bundle100/version0.0
> 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
> 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
> 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
> 227K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
> 231K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.anjeve.de%2Ffoaf.rdf
> 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
> 228K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
> 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdavelevy.info%2Ffoaf.rdf
> 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
> 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2F
> 258K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
> 225K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
> 227K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
> 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Ftbox.graph
> 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
> 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
> 228K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.w3.org%2FPeople%2FBerners-Lee%2Fcard
> 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
> 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fah1
> 224K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
> 226K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbigasterisk.com%2Ffoaf.rdf
> 223K   felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ftest.com%2F
> 4.9M   felix-cache/bundle100/data/tdb-data/graph
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
> 223K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fcontent.graph
> 227K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fsystem.graph
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
> 227K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fconfig.graph
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2F
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
> 228K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fgraph-access.graph
> 608K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fweb-resources-cache.graph1312967243159
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.rdf
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
> 224K   felix-cache/bundle100/data/tdb-data/mgraph/https%3A%2F%2Fbblfish.net%2Fuser%2Fadmin%2Fprofile
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.xml
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ftest.com%2F
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
> 222K   felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
> 5.6M   felix-cache/bundle100/data/tdb-data/mgraph
>  11M   felix-cache/bundle100/data/tdb-data
>  11M   felix-cache/bundle100/data
>  11M   felix-cache/bundle100
> 
> It would be interesting to compare those sizes with Sesame. 
> 
> 
>> 
>> Thanks for pointing that out. I just checked the size of bundle 100 and just on my
pretty empty test
>> database that I run locally and delete every so often, it is 1.5GB!
>> 
>> $ du -d 2 -h felix-cache/bundle100/
>> 1.5G	felix-cache/bundle100//data/tdb-data
>> 1.5G	felix-cache/bundle100//data
>> 16K	felix-cache/bundle100//version0.0
>> 1.5G	felix-cache/bundle100/
>> 
>> So for the Social Web applications I am working where I would like to work with a
lot of graphs, this is not good. I'd like to know the reason for this. But it does look like
a reason to switch to Sesame otherwise...
>> 
>> Henry
>> 
>> 
>>> 
>>> 
>>> Cheers
>>> Tsuy
>>> 
>> 
>> Social Web Architect
>> http://bblfish.net/
>> 
> 
> Social Web Architect
> http://bblfish.net/
> 

--trialox ag--------------------------------------

Tsuyoshi Ito
Hardturmstrasse 101
CH-8005 Z├╝rich
URL: http://trialox.org


Mime
View raw message