From issues-return-82178-archive-asf-public=cust-asf.ponee.io@ambari.apache.org Fri Jan 29 16:51:03 2021 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-he-de.apache.org (mxout1-he-de.apache.org [95.216.194.37]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id 0EF6B18064F for ; Fri, 29 Jan 2021 17:51:03 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-he-de.apache.org (ASF Mail Server at mxout1-he-de.apache.org) with SMTP id 77AF165A65 for ; Fri, 29 Jan 2021 16:51:02 +0000 (UTC) Received: (qmail 71302 invoked by uid 500); 29 Jan 2021 16:51:01 -0000 Mailing-List: contact issues-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list issues@ambari.apache.org Received: (qmail 71293 invoked by uid 99); 29 Jan 2021 16:51:01 -0000 Received: from mailrelay1-he-de.apache.org (HELO mailrelay1-he-de.apache.org) (116.203.21.61) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jan 2021 16:51:01 +0000 Received: from jira2-he-de.apache.org (jira2-he-de.apache.org [168.119.33.54]) by mailrelay1-he-de.apache.org (ASF Mail Server at mailrelay1-he-de.apache.org) with ESMTPS id 80A7E3E8AC for ; Fri, 29 Jan 2021 16:51:00 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id 6BB8AC8049E for ; Fri, 29 Jan 2021 16:51:00 +0000 (UTC) Date: Fri, 29 Jan 2021 16:51:00 +0000 (UTC) From: "amarnath reddy pappu (Jira)" To: issues@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (AMBARI-25458) DB Purge takes lot of time/hung MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/AMBARI-25458?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D17= 274562#comment-17274562 ]=20 amarnath reddy pappu edited comment on AMBARI-25458 at 1/29/21, 4:50 PM: ------------------------------------------------------------------------- By the time you hit this issue, Ambari would have already purged most of th= e historical purge data, so it is safe to=C2=A0 stop the purging command an= d leave it like that. =C2=A0 other option is truncating alert_current, alert_history and alert_notice ta= bles if retaining old alerts is not a concern. was (Author: apappu@hortonworks.com): By this time Ambari would have already purged most of the historical purge = data, so it is safe to=C2=A0 stop the purging command and leave it like tha= t. =C2=A0 other option is truncating alert_current, alert_history and alert_notice ta= bles. > DB Purge takes lot of time/hung > ------------------------------- > > Key: AMBARI-25458 > URL: https://issues.apache.org/jira/browse/AMBARI-25458 > Project: Ambari > Issue Type: Bug > Components: ambari-server > Affects Versions: 2.7.5 > Reporter: amarnath reddy pappu > Priority: Major > > =C2=A0 > During the DB Purge - alert_history table clean up is not doing with batc= h - Ambari gets hung or takes lot of time. > =C2=A0 > {noformat} > 2020-01-15 22:36:39,384 INFO [main] AlertsDAO:1537 - Deleting AlertCurre= nt entity batch with history ids: 533910 - 534898 > 2020-01-15 22:36:39,392 INFO [main] AlertsDAO:1537 - Deleting AlertCurre= nt entity batch with history ids: 534900 - 536020 > 2020-01-15 22:36:39,398 INFO [main] AlertsDAO:1537 - Deleting AlertCurre= nt entity batch with history ids: 536022 - 537203 > 2020-01-15 22:36:39,404 INFO [main] AlertsDAO:1537 - Deleting AlertCurre= nt entity batch with history ids: 537092 - 537633 > 2020-01-15 22:36:39,411 INFO [main] AlertsDAO:1570 - Starting: Delete/up= date entries older than [ 1531180800000 ] for entity [class org.apache.amba= ri.server.orm.entities.AlertHistoryEntity] > 2020-01-15 22:43:48,235 INFO [main] AlertsDAO:1581 - Completed: Delete/u= pdate entries older than [ 1531180800000 ] for entity: [class org.apache.am= bari.server.orm.entities.AlertHistoryEntity]. Number of entities deleted: [= 19480] > 2020-01-15 22:43:48,259 INFO [main] CleanupServiceImpl:80 - Running the = purge process for DAO: [org.apache.ambari.server.orm.dao.RequestDAO$$Enhanc= erByGuice$$f11e85aa@677349fb] with cleanup policy: [org.apache.ambari.serve= r.cleanup.TimeBasedCleanupPolicy@4466cf5d] > 2020-01-15 22:43:48,283 INFO [main] RequestDAO:314 - Deleting ExecutionC= ommand entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,284 INFO [main] RequestDAO:314 - Deleting TopologyLo= gicalTask entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,284 INFO [main] RequestDAO:314 - Deleting TopologyHo= stTask entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,284 INFO [main] RequestDAO:314 - Deleting TopologyHo= stRequest entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,284 INFO [main] RequestDAO:314 - Deleting HostRoleCo= mmand entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,285 INFO [main] RequestDAO:349 - Deleting RoleSucces= sCriteria entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,285 INFO [main] RequestDAO:349 - Deleting Stage enti= ties before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,285 INFO [main] RequestDAO:314 - Deleting RequestRes= ourceFilter entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,285 INFO [main] RequestDAO:314 - Deleting RequestOpe= rationLevel entities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,285 INFO [main] RequestDAO:314 - Deleting Request en= tities before date Tue Jul 10 00:00:00 UTC 2018 > 2020-01-15 22:43:48,288 INFO [main] CleanupDriver:100 - DB-PURGE - compl= eted. Number of affected records [22276]{noformat} > During the DB Purge - alert_history table clean up is not doing with batc= h - Ambari gets hung or takes lot of time. -- This message was sent by Atlassian Jira (v8.3.4#803005)