Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1CA702009C6 for ; Tue, 17 May 2016 01:11:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1B382160A19; Mon, 16 May 2016 23:11:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 61B31160A16 for ; Tue, 17 May 2016 01:11:04 +0200 (CEST) Received: (qmail 23406 invoked by uid 500); 16 May 2016 23:11:03 -0000 Mailing-List: contact dev-help@asterixdb.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.incubator.apache.org Delivered-To: mailing list dev@asterixdb.incubator.apache.org Received: (qmail 23394 invoked by uid 99); 16 May 2016 23:11:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 May 2016 23:11:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id EA1D1C06CB for ; Mon, 16 May 2016 23:11:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.477 X-Spam-Level: * X-Spam-Status: No, score=1.477 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, PLING_QUERY=0.279, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id LyJlPP6pcbYx for ; Mon, 16 May 2016 23:11:02 +0000 (UTC) Received: from mail-pf0-f180.google.com (mail-pf0-f180.google.com [209.85.192.180]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 8A9175FB08 for ; Mon, 16 May 2016 23:11:01 +0000 (UTC) Received: by mail-pf0-f180.google.com with SMTP id 206so72555412pfu.0 for ; Mon, 16 May 2016 16:11:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:message-id:mime-version:subject:date:references:to:in-reply-to; bh=VeqNiThrexfXvgGb4lC0HwGQBovnd89CHKvSd6+X3+M=; b=TSg7zcz0dVgaHovA0VgmTkxtfpCZqEPHup8ZsJ2Jsyt+adOAxWqcfuzxEPY417to5T kQy8gpkfjtYVDo9l4USvpnO8Bvn/oyGty0SYVN0HN7WOS+JtJ9ml6hSoEjgVQq7iQ6DF JiYE68bGeAYcT0ajtMA31jpg3HZFeyC4dVjH3/kD63Ypb+Td2vq9O5mq8jGQ9O1v7S+9 O+mHoOwM7OKKbc9P+0N4UkvEJVdoAwKGDyL8RZlpsFAQgSJtBAu5ZqQLF1P2KhfayhRr FUnMOwSKHIaprtpTPEQgE8lN6YtAv7OGM5eZhIL3DY2lj2AiGFJx2aTf6A4EOgkdrcw1 Omww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:message-id:mime-version:subject:date :references:to:in-reply-to; bh=VeqNiThrexfXvgGb4lC0HwGQBovnd89CHKvSd6+X3+M=; b=kBYgHXA9n8isqIa9AhKcUuJr4kePr/jnWvjH533qtHvjNnviJ5Si0R7EIGOtp1xwbu 3nUhqR7BAN7k2w+f7SoYE7eeUIfiu+Ew4QGgQMng27WZdbq9SvDUkko1qooTfYiYgGhZ Z5b8jYxjkQikU/u05JGGH00Y4Ba1dgwFudoj7Xn4zydhZDOCwQDE4TdP1BVS1mFgp5Ps m/CEjY5MncfWPciPe1zKKdazInVEZ7GJtiZsog0Xv0ypfP42fSN5aiEDT6ho9D29TZ8n yukkMUsoPpOOfFdJyLYZ5sb0hK6sxwPPHrWk+MVPazNURSVUfL524IT25Upwrbzfd1QF 13IA== X-Gm-Message-State: AOPr4FUPGu8mvHxi7YMLNArJkw1dg9PRuNQpb6F9/9jNz3GK1Uwnk0Fh22IXMSJu5eLVEw== X-Received: by 10.98.100.77 with SMTP id y74mr49472592pfb.101.1463440260468; Mon, 16 May 2016 16:11:00 -0700 (PDT) Received: from dhcp-v024-087.mobile.uci.edu (dhcp-v024-087.mobile.uci.edu. [169.234.24.87]) by smtp.gmail.com with ESMTPSA id h1sm49531772pfh.49.2016.05.16.16.10.59 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 16 May 2016 16:10:59 -0700 (PDT) From: Jianfeng Jia Content-Type: multipart/alternative; boundary="Apple-Mail=_FE258073-6EED-4F2F-B6B6-68A2FFB1BF5F" Message-Id: Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Help! Any idea to stop AsterixDB from recovering? Date: Mon, 16 May 2016 16:10:58 -0700 References: <4CB6C1F8-D0E8-4C4C-9B8B-42AE6B987AF5@gmail.com> <010902BB-7436-49BD-86D7-92C6384EF1B8@gmail.com> <9BE2BEEF-5FAD-4794-9B7A-2400213F855C@gmail.com> To: dev@asterixdb.incubator.apache.org In-Reply-To: X-Mailer: Apple Mail (2.3124) archived-at: Mon, 16 May 2016 23:11:05 -0000 --Apple-Mail=_FE258073-6EED-4F2F-B6B6-68A2FFB1BF5F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I think the BuffeCache is the core issue, the recovery process may just = run into the same spin trap where it was stopped. And I create another issue that we should be able to Abort the task so = that we don=E2=80=99t need to restart the server. > On May 16, 2016, at 7:24 AM, Michael Blow = wrote: >=20 > This might be related: (ASTERIXDB-1438) BufferCache spins indefinitely = when > cache is exceeded. >=20 > https://issues.apache.org/jira/browse/ASTERIXDB-1438 >=20 > Thanks, >=20 > -MDB >=20 > On Mon, May 16, 2016 at 1:52 AM Mike Carey wrote: >=20 >> Glad it worked out - can someone also capture the core issue in JIRA? = Thx! >> On May 15, 2016 11:40 PM, "Jianfeng Jia" = wrote: >>=20 >>> Great! The server is back now. Thanks a lot! >>>> On May 15, 2016, at 2:26 PM, Murtadha Hubail >>> wrote: >>>>=20 >>>> You can delete the existing log files and create new empty ones = with >>> incremented log file number, but it is very important that you = don't >>> delete the checkpoint file. >>>> Of course any data in the old log files will be lost, but the data >>> already on disk will be available. >>>>=20 >>>>> On May 15, 2016, at 1:23 PM, Jianfeng Jia >>> wrote: >>>>>=20 >>>>> Hi, >>>>> We submitted a long running join+insert query and stop the cluster = to >>> stop running it. However, when it restarted it ran the recovery = forever, >>>>> the logs shows that it is creating a lot of buffer cache. >>>>>=20 >>>>> In order to bring the cluster back to answer the query, is there = any >>> hacking solutions? such as remove the recovery txnlogs? I=E2=80=99m = worried that >> it >>> will ruin the cluster somehow. >>>>> We are in a contest so any early helps are really appreciated! = Thanks! >>>>>=20 >>>>>=20 >>>>> Best, >>>>>=20 >>>>> Jianfeng Jia >>>>> PhD Candidate of Computer Science >>>>> University of California, Irvine >>>>>=20 >>>=20 >>>=20 >>>=20 >>> Best, >>>=20 >>> Jianfeng Jia >>> PhD Candidate of Computer Science >>> University of California, Irvine >>>=20 >>>=20 >>=20 Best, Jianfeng Jia PhD Candidate of Computer Science University of California, Irvine --Apple-Mail=_FE258073-6EED-4F2F-B6B6-68A2FFB1BF5F--