From dev-return-6886-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Thu Oct 25 23:05:13 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 63AE3180670 for ; Thu, 25 Oct 2018 23:05:12 +0200 (CEST) Received: (qmail 72690 invoked by uid 500); 25 Oct 2018 21:05:11 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 72670 invoked by uid 99); 25 Oct 2018 21:05:10 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Oct 2018 21:05:10 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 333AA185AD0 for ; Thu, 25 Oct 2018 21:05:10 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.89 X-Spam-Level: * X-Spam-Status: No, score=1.89 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, T_DKIMWL_WL_HIGH=-0.01] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=opentable.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id zwA3D0bgDFQO for ; Thu, 25 Oct 2018 21:05:06 +0000 (UTC) Received: from mail-io1-f50.google.com (mail-io1-f50.google.com [209.85.166.50]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 793D05F42F for ; Thu, 25 Oct 2018 21:05:06 +0000 (UTC) Received: by mail-io1-f50.google.com with SMTP id p83-v6so6377191iod.12 for ; Thu, 25 Oct 2018 14:05:06 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=pmKT/X/snRp1PjPvsJizc3zEUnMMMnh9fOBCpS3hdUc=; b=SzucA8+RX2xfMUnDRVYC3N5Qrl9sb7SChpdFqgI2q82FHW9AMAjZ0bDJHfMqHCZcrB JbtZZ0ZroNAC7P3tx7cSIsgObx3eQEPWqUE8YK3SWb356oKpyMNePNC8JHBU2tvKQs+0 qAlUZ6oMXm3zasU5nwppXPXT1OUVm5jk8MdOl1yy2klSePcTWkQJ/3NLGCODn89nBdeK CtDQ11AlyjmThyRSY7nfOcsZjqSemn1iuACCCZEpaYX9/oJaVTsbuRQ+kEI4bH4TWgoP A4eYtDRvxFULt8QczmuCvPyO7qLZsVPOxqTYpL0WMxzW16/VTz8ivRDfchI3WgZCzl8L 0BUg== X-Gm-Message-State: AGRZ1gKYhtiap1nydTb4XwbkZA+0r0PcpxAjCg7If5wz1zdHjhq7FgIH an+x+LrSy/MQF3AOaPA0gbHILxMNaVrrGTe12w/Wfb9bHHE= X-Google-Smtp-Source: AJdET5eqb/wbGYg54m9CzWwC35OHD3LOqGodsSHtY0iaNVrG4+pueMpSs+BretN+kX0BGVn7ape5v8PPOtAUDeyJb7k= X-Received: by 2002:a6b:e009:: with SMTP id z9-v6mr590927iog.44.1540501499730; Thu, 25 Oct 2018 14:04:59 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Frank Maritato Date: Thu, 25 Oct 2018 14:04:48 -0700 Message-ID: Subject: Re: [IE] Re: [External] RE: [IE] airflow ui not showing logs To: dev@airflow.incubator.apache.org Content-Type: multipart/alternative; boundary="000000000000aafa75057913f4f2" --000000000000aafa75057913f4f2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Ok, I finally had time to try and track down the issue. Looks like the cfg option 'task_log_reader' was changed at some point prior to 1.10.0. Previously, my airflow.cfg had: task_log_reader =3D file.task But now it needs to be set to task_log_reader =3D task On Mon, Oct 15, 2018 at 1:57 PM Frank Maritato wrote: > James - No, my configuration doesn't have a setting for rbac, so I'm > assuming the default is False. > > Sunil - We are currently running the LocalExecutor. Is the worker process > just for Celery? According to the quickstart, I thought the only processe= s > we need to start are the webserver and scheduler. > > > On Mon, Oct 15, 2018 at 12:32 PM Sunil Varma Chiluvuri < > SunilVarma.Chiluvuri@equifax.com> wrote: > >> Frank, >> >> The serve_logs process usually starts automatically with the 'airflow >> worker' command. Try restarting your worker process and see if it also >> starts the serve_logs process. >> >> I've had a situation where the serve_logs process went down for some >> reason and restarting the worker fixed it. It doesn't explain the cause >> but could possibly resolve your issue. >> >> Sunil >> >> -----Original Message----- >> From: Frank Maritato [mailto:fmaritato@opentable.com.INVALID] >> Sent: Monday, October 15, 2018 2:14 PM >> To: dev@airflow.incubator.apache.org >> Subject: [IE] Re: [External] RE: [IE] airflow ui not showing logs >> >> Hi Sunil, >> >> I don't see this process running. I have never had to run this command >> previously. Should it have started as part of the 'airflow webserver' >> command? >> I ran it manually from the command line as 'airflow serve_logs &' (does >> not >> have a daemon option I guess) but I am still not seeing logs in the ui. = I >> did verify with netstat that it is running on port 8793. >> >> >> On Mon, Oct 15, 2018 at 12:02 PM Sunil Varma Chiluvuri < >> SunilVarma.Chiluvuri@equifax.com> wrote: >> >> > Check if the serve_logs process is running alongside your worker >> > process(es). This is the process that takes the log files written to >> disk >> > and serves them to the web UI. It should be running on port 8793 by >> default. >> > >> > Sunil >> > >> > -----Original Message----- >> > From: Frank Maritato [mailto:fmaritato@opentable.com.INVALID] >> > Sent: Monday, October 15, 2018 1:42 PM >> > To: dev@airflow.incubator.apache.org >> > Subject: [IE] airflow ui not showing logs >> > >> > Hi All, >> > >> > I'm running airflow 1.10.0 and the ui isn't showing the task logs >> anymore. >> > This has worked in the past so I'm not sure what changed. I was able t= o >> > verify that the logs are definitely being written to the same local >> > directory as what is specified in the airflow.cfg 'base_log_folder'. I >> > don't see any errors or debug in the airflow-webserver.{out|err} logs.= I >> > tried restarting the process and it still doesn't work. >> > >> > Anyone know how I can track this down? >> > -- >> > Frank Maritato >> > This message contains proprietary information from Equifax which may b= e >> > confidential. If you are not an intended recipient, please refrain fro= m >> any >> > disclosure, copying, distribution or use of this information and note >> that >> > such actions are prohibited. If you have received this transmission in >> > error, please notify by e-mail postmaster@equifax.com. Equifax=C2=AE i= s a >> > registered trademark of Equifax Inc. All rights reserved. >> > >> >> >> -- >> >> Frank Maritato >> This message contains proprietary information from Equifax which may be >> confidential. If you are not an intended recipient, please refrain from = any >> disclosure, copying, distribution or use of this information and note th= at >> such actions are prohibited. If you have received this transmission in >> error, please notify by e-mail postmaster@equifax.com. Equifax=C2=AE is = a >> registered trademark of Equifax Inc. All rights reserved. >> > > > -- > > Frank Maritato > --=20 Frank Maritato --000000000000aafa75057913f4f2--