Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B97E7200C84 for ; Mon, 29 May 2017 13:59:28 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B7BEF160BCE; Mon, 29 May 2017 11:59:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 094F3160BC2 for ; Mon, 29 May 2017 13:59:27 +0200 (CEST) Received: (qmail 80679 invoked by uid 500); 29 May 2017 11:59:26 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 80667 invoked by uid 99); 29 May 2017 11:59:26 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 May 2017 11:59:26 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D25C8C061C for ; Mon, 29 May 2017 11:59:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.979 X-Spam-Level: * X-Spam-Status: No, score=1.979 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yousician-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id EgrbCVf_AUu7 for ; Mon, 29 May 2017 11:59:24 +0000 (UTC) Received: from mail-yw0-f182.google.com (mail-yw0-f182.google.com [209.85.161.182]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C19BC5FC7F for ; Mon, 29 May 2017 11:59:23 +0000 (UTC) Received: by mail-yw0-f182.google.com with SMTP id l74so27763681ywe.2 for ; Mon, 29 May 2017 04:59:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yousician-com.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=LgroiT+awQdQ5cdEZGNI7cIcP61I+HHIUK85N0wpMvY=; b=O6bmX8f53GXYbALmeUsEl/ZOAMPWRHkLV5D5nSrRdo6LPkVYGZhiHL94XIze0PKexw A9pDozCvbiqnZdUk5gv2I3uQWhDStDxS4ZvRro/SiVkgK4rds+U0t0POjtyaCLPfIZJo 9NywSs7zj+cbCogvGqEyMY42VAluAQnB9Zx8SCKAaV+BURjBwrYUI72zDl7T6nrtXSoi 5LG4Z5MRQzn7WSCsMBCvOpnxNqaWolgStHQVudrtZDMxentuO8Zvs/zO4syqdN44cUsv 3YO1qkuzOhJw8zaL6QRr0KXmyuRo5zaI6HsUpAYx5O/bIus7BYxriKDMMUMJa/Rockoe rzoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=LgroiT+awQdQ5cdEZGNI7cIcP61I+HHIUK85N0wpMvY=; b=RnO/xgxFq/hR5hRu0r72edFJ924nfQ/wThoLTVlTbkbEXOBE/t26k/NtfshKpdmfLR WgLivQV8318qBK4GFEiEw5JmPIMXK1+359J9Gu+vj4rhNDtJbzQoBr78o/KjXi3oRLOG iH1fstG0e4Eg+N4CIu7hCVfAHB9vSzjTgHT7YRQzaK7V8RkAj8Sx0tlKSjJeqRK7StrJ bA1zqEV7znWH7b2w9QMaFXIWa1q1JPMtQE2uerAYLg8+t/hhg+ti7z9sjSOoCu0TjTIZ xUM8FZ8si2ojf9I9LVyKbf7Po6YnFxHbNcFcxCG07R6g4tyG74BHz09z4LF72WzvrF/x 68QA== X-Gm-Message-State: AODbwcAR3+T93qvL9WxSM4DcD7/3hKa6gNjrP1/1y6WQhf3eUh+pVSrm 0o6LGkpl9OjIxhAadyPPLmB8p2w5ZOIm X-Received: by 10.129.174.76 with SMTP id g12mr11234792ywk.34.1496059157015; Mon, 29 May 2017 04:59:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.13.209.1 with HTTP; Mon, 29 May 2017 04:59:16 -0700 (PDT) From: Dmitry Smirnow Date: Mon, 29 May 2017 14:59:16 +0300 Message-ID: Subject: large number of messages from celeryev pile up in rabbitmq To: dev@airflow.apache.org Content-Type: multipart/alternative; boundary="f403045f6e509e05f50550a86a4c" archived-at: Mon, 29 May 2017 11:59:28 -0000 --f403045f6e509e05f50550a86a4c Content-Type: text/plain; charset="UTF-8" Hi, I've noticed that in the rabbitmq which is used as a broker for Airflow, there are thousands of heartbeat messages from workers piling up (type: "worker-heartbeat"). The version I use is 1.7.1.3. I googled around and it seems that those are the events used by celery flower for monitoring. I may misunderstood something, but it seemed that to stop those messages I should for example set some celery settings to make the unused queues expire. What would be the right way to deal with it? I'm really not sure which config should I touch. Any ideas are welcome and if I need to provide more info about configuration - please suggest which one. Thank you in advance, Best regards, Dima -- Dmitry Smirnov (MSc.) Data Engineer @ Yousician mobile: +358 50 3015072 --f403045f6e509e05f50550a86a4c--