From user-return-24962-archive-asf-public=cust-asf.ponee.io@flink.apache.org Tue Dec 18 19:43:16 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id A92E9180669 for ; Tue, 18 Dec 2018 19:43:15 +0100 (CET) Received: (qmail 92270 invoked by uid 500); 18 Dec 2018 18:43:14 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 92260 invoked by uid 99); 18 Dec 2018 18:43:14 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Dec 2018 18:43:14 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D20D6C033A for ; Tue, 18 Dec 2018 18:43:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.002 X-Spam-Level: X-Spam-Status: No, score=-0.002 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=data-artisans-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id A28j1Tq6ki6k for ; Tue, 18 Dec 2018 18:43:12 +0000 (UTC) Received: from mail-ed1-f54.google.com (mail-ed1-f54.google.com [209.85.208.54]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id C021E61078 for ; Tue, 18 Dec 2018 18:43:11 +0000 (UTC) Received: by mail-ed1-f54.google.com with SMTP id b14so14739662edt.6 for ; Tue, 18 Dec 2018 10:43:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=data-artisans-com.20150623.gappssmtp.com; s=20150623; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=jSIC4lsGSIDKiCTMc85/P9L7ZVhmURQaVdDU+38wVbo=; b=wEhqfE6qm2Gbh/NN0Qb3u6LDp/q2OtPqy5um7TuP+CkgbeMp7535u1yK6Dnn+XOq5C 0ot9zanMeu8cHGrVhTe6QM9fbLLdK8cwS7FMdFUTdvnGKDG16hSRHEwLJOBglSWog79D KV/62Ufkp3Tos5yxR/lME8i+MmU2XSKprVIG6a7SbjDEoruuQ/dvKDOnMUtijJimUab3 QLLrYyVIR1dvTqZeavEyYc0zkWwS7/rS1MYBZbTCYZKxa0BVRYwAnROclnF2iiKZoSj6 tsOJJwlogYVHA+1gbjhRmfIyVsGiL+MSzcphfK4hlEN2wsMd6wiErVMsE++xCOHpS9EN EXMg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=jSIC4lsGSIDKiCTMc85/P9L7ZVhmURQaVdDU+38wVbo=; b=odrUrR9ybk0ffP1PslNG5RCCSmfjLwifASVG1+LlIbrumJrTrJ/YcnkEBpLAaFZUM+ SLi5Eq3WgOpc3729mePVS02zdSfaeF+H/cgQAaWepnifq3ypiahxXt0Bu8AUPet3yMXg nLBgT6yPUi67b05LoVd3vOIwhZIM+I4Yph5ttNwkYt95SJHLcqgr8Bu74e5mA8SEVLIQ zNSPZRri2Izar5xc1wjreFNA209bu8ZCNE6ebdjt5Qm8phNz/sIP9gpviKHHNRmrJVlJ gxErdbl516qglep7dm8/T2urLDoZKS7FgOq5QsXWeCCdMqDpIsBmzBpajkX0ixK6zPMh +tEg== X-Gm-Message-State: AA+aEWbaPrAtK4YSr3CGPq7Sm2YijLH/lLlncb3KXoVQUffknWHmoZep knRCK+l/RjZySzMMFagkqPiJlA== X-Google-Smtp-Source: AFSGD/W9uSYQBRJwd58OOpH8vwx/pIFEB9Zh6suR71uBLle/ez0bU4KDZ3/1KuZdFUsnDPDslOn3Tw== X-Received: by 2002:a50:a246:: with SMTP id 64mr17621589edl.43.1545158584685; Tue, 18 Dec 2018 10:43:04 -0800 (PST) Received: from andreys-mbp.office.data-artisans.net (dslb-002-205-086-134.002.205.pools.vodafone-ip.de. [2.205.86.134]) by smtp.gmail.com with ESMTPSA id 24sm4615631eds.97.2018.12.18.10.43.03 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 18 Dec 2018 10:43:03 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: TimerService Troubleshooting/Metrics From: Andrey Zagrebin In-Reply-To: Date: Tue, 18 Dec 2018 19:43:02 +0100 Cc: user , Stefan Richter Content-Transfer-Encoding: quoted-printable Message-Id: <499343F8-4C14-41E9-8AE3-4B24B8F1B9E1@data-artisans.com> References: To: sayat X-Mailer: Apple Mail (2.3445.102.3) Hi Sayat, As far as I know, there are no timer service metrics exposed at the = moment. I pull in Stefan into the thread, maybe, he could add more. In case of RocksDB, you can try enabling RocksDB internal metrics [1]. Timer service uses RocksDB state backend to queue timers and has a = dedicated column in RocksDB. The metrics of this column might help, like = 'state.backend.rocksdb.metrics.estimate-num-keys=E2=80=99. Best, Andrey [1] = https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/config.htm= l#rocksdb-native-metrics > On 14 Dec 2018, at 16:01, sayat wrote: >=20 > Dear Flink Community, >=20 > Is there a way of troubleshooting timer service? In the docs, it says = that the service might degrade a job performance significantly. Is there = a way how to expose and see timer service metrics i.e. length of the = priority queue, how many time the service fires etc?