Return-Path: X-Original-To: apmail-manifoldcf-dev-archive@www.apache.org Delivered-To: apmail-manifoldcf-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 009D217843 for ; Fri, 17 Oct 2014 12:00:47 +0000 (UTC) Received: (qmail 55181 invoked by uid 500); 17 Oct 2014 12:00:46 -0000 Delivered-To: apmail-manifoldcf-dev-archive@manifoldcf.apache.org Received: (qmail 55132 invoked by uid 500); 17 Oct 2014 12:00:46 -0000 Mailing-List: contact dev-help@manifoldcf.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@manifoldcf.apache.org Delivered-To: mailing list dev@manifoldcf.apache.org Received: (qmail 55120 invoked by uid 99); 17 Oct 2014 12:00:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Oct 2014 12:00:46 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of daddywri@gmail.com designates 209.85.213.41 as permitted sender) Received: from [209.85.213.41] (HELO mail-yh0-f41.google.com) (209.85.213.41) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 17 Oct 2014 12:00:40 +0000 Received: by mail-yh0-f41.google.com with SMTP id i57so280428yha.28 for ; Fri, 17 Oct 2014 05:00:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=TVVTTSQvrE1xT9VFfObJHwwDhUUZ9RdppzNOaq9D2IY=; b=r9smvuBUjvV7Mw+CGJk5SEpXbTcCRzBQKkxUkSwqep1BAYumSlbi7jL/8G4BvIX0OS yfoJqUzBoJdv7GT9tH4ovudNjknrGXrqlUcx95QOZDuhHhzGi6kJqr6cMtH11BUxiA9A 79EdoLezyNvEovE9Po3d//8wV8HWQDkqN3gRUx1Oy4phmSA0gytHK+w1l7dSUirmcnMq Uo94xX23IMo+zUWclwDacZP+IBwYyxUjjppFa3jUgkrzu41sEoTSX236gNGXsoyyPwEO K3pECFkn7a3vMdxnrgUhWyQpwHU3oABouo5AT6ozx3ebKbKMoFrcjFSLYxZyzeRUsdOZ HUkQ== MIME-Version: 1.0 X-Received: by 10.236.7.52 with SMTP id 40mr2508419yho.172.1413547220318; Fri, 17 Oct 2014 05:00:20 -0700 (PDT) Received: by 10.170.189.214 with HTTP; Fri, 17 Oct 2014 05:00:20 -0700 (PDT) In-Reply-To: References: <1C582273-0DEA-4BCF-8682-C17BCA47175F@gmail.com> Date: Fri, 17 Oct 2014 08:00:20 -0400 Message-ID: Subject: Re: Logging From: Karl Wright To: dev Content-Type: multipart/alternative; boundary=001a1133e48af0bf0f05059d1b55 X-Virus-Checked: Checked by ClamAV on apache.org --001a1133e48af0bf0f05059d1b55 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I've created a ticket for this work: CONNECTORS-1077. Some work has already been done (e.g. for the document filter transformer), but if you would like to help work on this also I would be happy to have a collaborator. Thanks, Karl On Fri, Oct 17, 2014 at 7:53 AM, Muhammed Olgun wrote: > Hi Karl, > > You are right. Thank you. > > Muhammed > > On 17 Oct 2014, at 13:49, Karl Wright wrote: > > > We *have* a feature that is cross-cluster and is meant for precisely th= is > > purpose. This is the history table. If Tika exceptions are not logged > as > > the result of a transformation attempt in this table, they should be. > > > > We've in general been slow to add support for activity logging in our > > connectors; perhaps we should put our effort towards fixing that proble= m. > > > > Thanks, > > Karl > > > > > > On Fri, Oct 17, 2014 at 6:46 AM, Karl Wright wrote= : > > > >> Hi Muhammed, > >> > >> In a cluster, where do you expect to look for the log file? The log > will > >> only apply to the cluster member running the crawler UI. > >> > >> Karl > >> > >> > >> On Fri, Oct 17, 2014 at 5:59 AM, Muhammed Olgun > >> wrote: > >> > >>> Hi Karl, > >>> > >>> I think that we can also read logging.ini file from the MCF and show, > for > >>> instance, last 50 lines of log file. > >>> > >>> We can see that is the document processed or not from the document > status > >>> report but we cannot see that why the document isn't processed. May b= e > >>> document isn't processed because there was a tika exception or > something > >>> different. We have to check the log file. > >>> > >>> If we can add such a feature, we will check the log file easily and w= e > >>> won=E2=80=99t have to access the server to check the log file. > >>> > >>> Muhammed > >>> > >>> > >>> On 17 Oct 2014, at 11:53, Karl Wright wrote: > >>> > >>>> Hi Muhammed, > >>>> > >>>> The problems with that idea are several: > >>>> > >>>> (1) You don't know where the logs are, or if/when they rolled. All = of > >>> that > >>>> is configured in the logging.ini file. > >>>> (2) The logs may be very very large. > >>>> (3) The logs are meant for a different sort of user than the typical > UI > >>>> user. > >>>> > >>>> The only programs I know who allow you to view logs capture them > >>> explicitly > >>>> themselves, for example Jenkins. > >>>> > >>>> It is probably far better to capture more kinds of activities in the > >>> simple > >>>> history than to try to provide a log viewer in the UI. Can you > describe > >>>> what you would want to look for? > >>>> > >>>> Karl > >>>> > >>>> > >>>> > >>>> On Fri, Oct 17, 2014 at 4:40 AM, Muhammed Olgun > >>> wrote: > >>>> > >>>>> Hi, > >>>>> > >>>>> I was thinking that we should add a feature which shows > manifoldcf.log > >>> in > >>>>> MCF's control panel. What do you think about it? > >>>>> > >>>>> Muhammed > >>>>> > >>> > >>> > >> > > --001a1133e48af0bf0f05059d1b55--