Mailing-List: contact stanbol-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: stanbol-dev@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of christ.fabian@googlemail.com
 designates 209.85.215.47 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAA7LAO3sNk63gKH9bjCA-GuxNGEpvhqB3sxKiWjgcAtEpc_EEw@mail.gmail.com>
References: <4E450071.2090204@flordeutopia.pt>
	<CAA7LAO0ShEC1ydRDwMoVkgZxYO8W4+07w0KvjOGYwQNhsmYFrw@mail.gmail.com>
	<4E4A4A23.3040505@flordeutopia.pt>
	<CAA7LAO3sNk63gKH9bjCA-GuxNGEpvhqB3sxKiWjgcAtEpc_EEw@mail.gmail.com>
Date: Mon, 29 Aug 2011 17:43:41 +0200
Message-ID: 
 <CA+_sZ+g=jNVmZLe=q9TtPHrJdDpcUmrySQp8Rpb6E=K8tAEgow@mail.gmail.com>
Subject: Re: Failed tests (Cache dbpediaDefaultdata Index is currently not
 active) during fresh "clean install" of r1156651
From: Fabian Christ <christ.fabian@googlemail.com>
To: stanbol-dev@incubator.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi,

I just had a problem with tests when re-running integration tests
without a 'mvn clean' before. Maybe this is the reason for this
failure.

- Fabian

2011/8/29 Rupert Westenthaler <rupert.westenthaler@gmail.com>:
> Hi
>
> First, sorry for the late respond, but I was a vacation the last 4 weeks.
>
> The log you provided is really strange and even after spending some
> time analyzing it I can only tell how the initialization failed but
> not why.
>
>
> The tests failed because the local cache of dbpedia.org was not
> initialized. This local cache consists of a dataset of 43k entities
> and a set of 4 OSGI service configurations. All such files are
> provided by the "org.apache.stanbol.data.sites.dbpedia.default"
> bundle. As far as I can tell all configurations where present and even
> loaded successfully. However somehow the OSGI service configuration
> where not parsed to the ConfigAdmin Service and therefore the required
> OSGI services where never activated.
> OSGI service configuration are processed by the Sling Installer
> framework (more precisely [2] module) and as far as I know this is the
> first time that there occurred a problem while installing such
> resources.
>
> If you (or someone else) is able to reproduce this. It would be very
> helpful to start Stanbol with DEBUG level logging and send the log.
> The Sling installer does provide very detailed loggings about the
> installation steps so this should help in detecting the cause for
> this. =C2=A0To activate the =C2=A0DEBUG log level you can add the paramet=
er "-l
> DEBUG" when starting Stanbol (see [1]).
>
> On Tue, Aug 16, 2011 at 12:44 PM, Alex Lopez <alopez@flordeutopia.pt> wro=
te:
>> Is this a coincidence? Or having run stanbol (like in 3 and 5) can reall=
y
>> affect the integration tests? Because it seams to me like IT are perform=
ed
>> in its own context, right?
>
> You are right, the integration tests start an own stanbol instance
> (the full launcher). Also starting Stanbol by using the -p parameter
> (to change the port to something other than 8080) is completely fine
> and is definitely not related to the reported problem.
>
> best
> Rupert
>
> [1] http://sling.apache.org/site/configuration.html#Configuration-Standal=
oneApplication
> [2] http://svn.apache.org/viewvc/sling/trunk/installer/factories/configur=
ation/
>
>> Thanks Rupert, see in-line answers:
>>
>>> Hi Alex
>>>
>>> There is no need to build your own index for testing/using Apache
>>> Stanbol. A default index is provided within the launcher jar and
>>> installed during the first start of Stanbol. Building indexes is an
>>> advanced feature that is not required for setting up Stanbol but
>>> typically used by users that want to customize existing indexes (e.g.
>>> including more entities, additional languages ...) or to build there
>>> own indexes (e.g. of a company thesaurus).
>>>
>>> Based on the information you provided I think that there was an error
>>> either (1) during the build of the
>>> "org.apache.stanbol.data.sites.dbpedia.default" bundle or during the
>>> (2) startup Stanbol instance used for the integration test.
>>>
>>> for (1) please check if the bundle located in
>>>
>>>
>>> {stanbol-root}/data/sites/dbpediadefault/org.apache.stanbol.data.sites.=
dbpedia.default-1.0.1-incubating.jar
>>
>> The file is there and is about 17MB.
>>
>>>
>>> is about 17 MByte in size. If it is smaller than that something went
>>> wrong while downloading the data for the default dbpedia index during
>>> the build process. If this is the case you could try to
>>>
>>> * delete
>>> data/sites/dbpediadefault/src/main/resources/org/apache/stanbol/data/si=
te/dbpedia/default/index/dbpedia_43k.solrindex.zip
>>> * rebuild this bundle by calling "mvn clean install" within
>>> "stanbol-root}/data/sites/dbpediadefault/"
>>>
>>> for looking into (2) it would be very helpful if you could provide the
>>> log of the stanbol server used for the integration tests because the
>>> errors you see in the console are mainly client side error messages
>>> plus some WebApplication level server errors.
>>>
>>> The file with the details loggings is located at
>>>
>>> =C2=A0 =C2=A0 {stanbol-root}/integration-tests/target/launchdir/sling/l=
ogs/error.log
>>
>> I'm sending the file. Today I repeated the tests and everything run fine=
. If
>> I remember well, what I did was:
>>
>> 1- Chekout stanbol r1156651
>>
>> 2- mvn clean install (worth noting, I had an already running tomcat at
>> 8080): it gave error.
>>
>> 3- Launched stanbol and confirmed everything looked fine:
>> java -Xmx1g -jar
>> /home/alex.lopez/stanbol/launchers/full/target/org.apache.stanbol.launch=
ers.full-0.9.0-incubating-SNAPSHOT.jar
>> -p 9090
>>
>> 4- mvn install -rf :org.apache.stanbol.integration-tests (still same err=
or)
>>
>> 5- Launched stanbol and did some playing around, analyzed some docs and
>> tried to create some local entities.
>>
>> 6- Today I re-tried mvn install -rf :org.apache.stanbol.integration-test=
s,
>> this time without errors. So all is fine, but still wanted to know why t=
he
>> errors first and later all OK...
>>
>>
>> Thanks again.
>>
>> Best,
>> Alex
>>
>>>
>>> I will have a look onto the logs if you can send them.
>>>
>>>
>>> best
>>> Rupert Westenthaler
>>>
>>> On Fri, Aug 12, 2011 at 12:29 PM, Alex Lopez<alopez@flordeutopia.pt>
>>> =C2=A0wrote:
>>>>
>>>> Hi Stanbol devs,
>>>>
>>>> finally the time has come for me to get my hands dirty with Stanbol.
>>>>
>>>> After following instructions in
>>>> http://incubator.apache.org/stanbol/docs/trunk/ and cheking out r11566=
51
>>>> everything goes fine until the Integration Tests:
>>>>
>>>> some 27 tests fail, all with same error:
>>>>
>>>> Aug 11, 2011 5:31:06 PM com.sun.jersey.spi.container.ContainerResponse
>>>> logException
>>>> SEVERE: Mapped exception to response: 500 (Internal Server Error)
>>>> javax.ws.rs.WebApplicationException:
>>>> org.apache.stanbol.entityhub.servicesapi.site.ReferencedSiteException:
>>>> Unable to get Represetnation h =C2=A0ttp://dbpedia.org/resource/Paris =
because
>>>> configured Cache dbpediaDefaultdataIndex is currently not available
>>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>>>>
>>>> org.apache.stanbol.entityhub.jersey.resource.ReferencedSiteRootResourc=
e.getEntityById(ReferencedSiteRootResource.java:231)
>>>> ...
>>>>
>>>> Caused by:
>>>> org.apache.stanbol.entityhub.servicesapi.site.ReferencedSiteException:
>>>> Unable to get Represetnation http://dbpedia.org/resource =C2=A0/Paris =
because
>>>> configured Cache dbpediaDefaultdataIndex is currently not available
>>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0at
>>>>
>>>> org.apache.stanbol.entityhub.core.impl.ReferencedSiteImpl.getEntity(Re=
ferencedSiteImpl.java:477)
>>>>
>>>>
>>>> So my guess is that some solr dbpedia indexes are missing (re.:
>>>>
>>>> http://mail-archives.apache.org/mod_mbox/incubator-stanbol-dev/201106.=
mbox/%3CBANLkTimwpuVmD0-fjzh9Q=3DqEKOxc2xQ8wQ@mail.gmail.com%3E
>>>> ) but reading the README at stanbol/data/sites/dbpedia it mentions tha=
t
>>>> the
>>>> index is no longer required and has been replaced by the indexing tool=
.
>>>> Can
>>>> you confirm that I have to follow instructions at
>>>> stanbol/entityhub/indexing/dbpedia/README.md to build the indexes myse=
lf?
>>>> (that this is not suposed to be part of the normal stanbol "clean
>>>> install"
>>>> procedure).
>>>>
>>>> Sorry if this is a dumb question, just want to be sure that I'm doing
>>>> things
>>>> right.
>>>>
>>>> Many thanks, and good day.
>>>>
>>>> Alex
>>>>
>>>
>>>
>>>
>>
>
>
>
> --
> | Rupert Westenthaler=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0 rupe=
rt.westenthaler@gmail.com
> | Bodenlehenstra=C3=9Fe 11=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0 ++43-699-1110890=
7
> | A-5500 Bischofshofen
>


--=20
Fabian
http://twitter.com/fctwitt