Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@manifoldcf.apache.org
Received-SPF: pass (athena.apache.org: local policy)
Message-ID: <52F3AF71.6060707@usit.uio.no>
Date: Thu, 06 Feb 2014 16:51:13 +0100
From: =?ISO-8859-1?Q?Erlend_Gar=E5sen?= <e.f.garasen@usit.uio.no>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8;
 rv:24.0) Gecko/20100101 Thunderbird/24.3.0
MIME-Version: 1.0
To: dev@manifoldcf.apache.org
Subject: Re: [VOTE] Release Apache ManifoldCF 1.5, RC7
References: 
 <CALUFAGBgnLRBSqhBcz44EUSThYYOKvGEKv=QK+NLd8BJ316TBA@mail.gmail.com>
	<52F359E8.4010205@usit.uio.no>
	<CALUFAGDh+mWP=etT95dRujjGWbcW-UK5FpV_Bzny1SjK7hD2nQ@mail.gmail.com>
	<CALUFAGCC-p2T3aZ4jQVVhNsRWPMJsr0PfqtcBM03a2+9PTKiQw@mail.gmail.com>
	<52F374E3.4090906@usit.uio.no>	<52F37924.6080807@usit.uio.no>
	<CALUFAGCVEXAz22S-m1d4-kYaHHsUVVH4dSR-o8uCZqucO1bY5g@mail.gmail.com>
	<52F390CE.6030204@usit.uio.no>
	<CALUFAGA0=xVEUO90WGiw9WCFZ8ebwSCcvtCryT+vfRAFZewOOA@mail.gmail.com>
	<52F399EC.8060404@usit.uio.no>
	<CALUFAGB1DnQ_Qqtv_DoJUoMtMnVwP6wV_y+2DZz7suJySAh9yw@mail.gmail.com>
	<52F3A119.40702@usit.uio.no>
 <CALUFAGBNUk4YBL8q-Nn42uuEPiQFaQTzeND+FpG6m+R5nj-Dxw@mail.gmail.com>
In-Reply-To: 
 <CALUFAGBNUk4YBL8q-Nn42uuEPiQFaQTzeND+FpG6m+R5nj-Dxw@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 06.02.14 15:53, Karl Wright wrote:
> Hi Erlend,
>
> Please go into the Simple History, and change the start time of the query
> to be one day earlier than the default.  By default, Simple History only
> reports the last hour's worth of events.

Then it only displays the crawl which completed tonight before I did the 
upgrade of MCF.

If Solr is indexing the documents, you should also see the entries in 
simple history. I changed the start time to four hours earlier than the 
default which should catch the Solr activity.

The query I posted seems to include an old start time (3rd of Feb) and 
that's the reason why pgAdmin displays a result set. At that time, I 
reindexed Solr prior to the MCF upgrade.

If I'm re-ingesting all documents and start the job, see activity in 
both our Solr log and in manifoldcf.log ("Decided to ingest...") . And 
if I continuously refreshing the simple history window, all I can see is 
fetching activities (and "job start" etc).

For some odd reason, '"document ingest (Solr)"' as an activity type does 
not seem to be added to my repohistory table after I did the upgrade.

Take a look at this query:
select count(*) from repohistory where owner='Web' AND starttime> 
1391691978799 and activitytype = 'fetch'
==> 141.
(This is everything from 1:06 pm until now.)

But then take a look at this one:
select starttime, activitytype from repohistory where owner='Web' AND 
starttime> 1391691978799 and activitytype <> 'fetch'
==>
1391693068680;"job stop"
1391693560219;"job start"
1391693602432;"robots parse"
1391694720907;"job stop"
1391694830347;"job start"
1391694870310;"job stop"
1391695481359;"job continue"
1391695518007;"robots parse"
1391696593141;"job end"

I can try to debug more tomorrow.

Erlend