Return-Path: X-Original-To: apmail-manifoldcf-dev-archive@www.apache.org Delivered-To: apmail-manifoldcf-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C4D4410A12 for ; Thu, 6 Feb 2014 17:32:51 +0000 (UTC) Received: (qmail 37662 invoked by uid 500); 6 Feb 2014 17:32:50 -0000 Delivered-To: apmail-manifoldcf-dev-archive@manifoldcf.apache.org Received: (qmail 37612 invoked by uid 500); 6 Feb 2014 17:32:50 -0000 Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list dev@manifoldcf.apache.org Received: (qmail 37601 invoked by uid 99); 6 Feb 2014 17:32:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Feb 2014 17:32:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of daddywri@gmail.com designates 209.85.216.51 as permitted sender) Received: from [209.85.216.51] (HELO mail-qa0-f51.google.com) (209.85.216.51) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Feb 2014 17:32:45 +0000 Received: by mail-qa0-f51.google.com with SMTP id f11so3253540qae.38 for ; Thu, 06 Feb 2014 09:32:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=gZLdkkuE3fw3fKzUyXppuFQ+CS7AHNYUjX/2kK6+FLg=; b=rlfagA0BRa0GAuXNmtuxLptpsDyBMCm3tyPI+DjA3+Ri6yzBjl2gxu7W/CxW+9HDTe /+Mc5ibvTIQ9jLlUs53nMuEfprQzHbE5PCgc7zNjxUkAXcf+W1qd+Dsi+d2VxJd+CtzO zEA/c9/ARHsolE7BWlE4mqMehPjNg5wh8MGlagJVvW+D7YHQgvsqJkxpbFR7yPiepZ5T 1Et9+rwmRzt390jVidocNYSQ1WUwTMpJ93POFR1V2TPd/JNdqoW5ZsS+7DlHyii6QWvs dCcdJWz9wNM77jBxl/6cUv3VSZx0z/BrHNuFZ72VH35S7UAtPUCHuCC0k2rgF15vNBvH s09Q== MIME-Version: 1.0 X-Received: by 10.224.160.83 with SMTP id m19mr14148561qax.21.1391706733212; Thu, 06 Feb 2014 09:12:13 -0800 (PST) Received: by 10.96.102.67 with HTTP; Thu, 6 Feb 2014 09:12:13 -0800 (PST) In-Reply-To: <52F3AF71.6060707@usit.uio.no> References: <52F359E8.4010205@usit.uio.no> <52F374E3.4090906@usit.uio.no> <52F37924.6080807@usit.uio.no> <52F390CE.6030204@usit.uio.no> <52F399EC.8060404@usit.uio.no> <52F3A119.40702@usit.uio.no> <52F3AF71.6060707@usit.uio.no> Date: Thu, 6 Feb 2014 12:12:13 -0500 Message-ID: Subject: Re: [VOTE] Release Apache ManifoldCF 1.5, RC7 From: Karl Wright To: dev Content-Type: multipart/alternative; boundary=047d7bacb2aa76f8d404f1bff91d X-Virus-Checked: Checked by ClamAV on apache.org --047d7bacb2aa76f8d404f1bff91d Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Ok, we're back then to the question of why your current job run does not log indexing history for Solr. I'll see if there's any reason that should be true based on the code. Karl On Thu, Feb 6, 2014 at 10:51 AM, Erlend Gar=E5sen = wrote: > On 06.02.14 15:53, Karl Wright wrote: > >> Hi Erlend, >> >> Please go into the Simple History, and change the start time of the quer= y >> to be one day earlier than the default. By default, Simple History only >> reports the last hour's worth of events. >> > > Then it only displays the crawl which completed tonight before I did the > upgrade of MCF. > > If Solr is indexing the documents, you should also see the entries in > simple history. I changed the start time to four hours earlier than the > default which should catch the Solr activity. > > The query I posted seems to include an old start time (3rd of Feb) and > that's the reason why pgAdmin displays a result set. At that time, I > reindexed Solr prior to the MCF upgrade. > > If I'm re-ingesting all documents and start the job, see activity in both > our Solr log and in manifoldcf.log ("Decided to ingest...") . And if I > continuously refreshing the simple history window, all I can see is > fetching activities (and "job start" etc). > > For some odd reason, '"document ingest (Solr)"' as an activity type does > not seem to be added to my repohistory table after I did the upgrade. > > Take a look at this query: > select count(*) from repohistory where owner=3D'Web' AND starttime> > 1391691978799 and activitytype =3D 'fetch' > =3D=3D> 141. > (This is everything from 1:06 pm until now.) > > But then take a look at this one: > select starttime, activitytype from repohistory where owner=3D'Web' AND > starttime> 1391691978799 and activitytype <> 'fetch' > =3D=3D> > 1391693068680;"job stop" > 1391693560219;"job start" > 1391693602432;"robots parse" > 1391694720907;"job stop" > 1391694830347;"job start" > 1391694870310;"job stop" > 1391695481359;"job continue" > 1391695518007;"robots parse" > 1391696593141;"job end" > > I can try to debug more tomorrow. > > Erlend > --047d7bacb2aa76f8d404f1bff91d--