Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 485D6200D18 for ; Tue, 26 Sep 2017 23:47:06 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 46DF51609D7; Tue, 26 Sep 2017 21:47:06 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 957281609C4 for ; Tue, 26 Sep 2017 23:47:05 +0200 (CEST) Received: (qmail 6065 invoked by uid 500); 26 Sep 2017 21:47:04 -0000 Mailing-List: contact dev-help@phoenix.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@phoenix.apache.org Delivered-To: mailing list dev@phoenix.apache.org Received: (qmail 5782 invoked by uid 99); 26 Sep 2017 21:47:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 26 Sep 2017 21:47:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 38EEEC2C3C for ; Tue, 26 Sep 2017 21:47:04 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id ElBeUBlodJ6M for ; Tue, 26 Sep 2017 21:47:03 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 424E95F2AD for ; Tue, 26 Sep 2017 21:47:03 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 86313E0F6F for ; Tue, 26 Sep 2017 22:00:28 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 473572425E for ; Tue, 26 Sep 2017 21:47:01 +0000 (UTC) Date: Tue, 26 Sep 2017 21:47:01 +0000 (UTC) From: "Sergey Soldatov (JIRA)" To: dev@phoenix.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (PHOENIX-4225) Using Google cache may lead to lock up on RS side. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 26 Sep 2017 21:47:06 -0000 [ https://issues.apache.org/jira/browse/PHOENIX-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Soldatov updated PHOENIX-4225: ------------------------------------- Attachment: PHOENIX-4225-1.patch Easy fix with calling cache cleanup when we try to get/add cache. Two test cases added : 1. check that after accessing expired cache the memory manager reports the correct value of available memory 2. Check that if cache has expired and never was accessed, adding new cache would not block the memory manager. > Using Google cache may lead to lock up on RS side. > --------------------------------------------------- > > Key: PHOENIX-4225 > URL: https://issues.apache.org/jira/browse/PHOENIX-4225 > Project: Phoenix > Issue Type: Bug > Reporter: Sergey Soldatov > Assignee: Sergey Soldatov > Fix For: 4.12.0 > > Attachments: PHOENIX-4225-1.patch > > > On the server side we are using google cache with life time bounds. This is integrated with GlobalMemoryManager which is used for almost all tasks that requires memory allocation. The problem is that when the cache member get removed, it doesn't send remove notification until next write/get operation happen. But in some cases once the large cache was removed (but memory manager doesn't know that since it relies on the notification), we try to resend it and memory manager get stuck waiting for free space, blocking all other operations with the memory manager. -- This message was sent by Atlassian JIRA (v6.4.14#64029)