Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C72AE200B6B for ; Thu, 11 Aug 2016 02:53:24 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C5EAD160AA4; Thu, 11 Aug 2016 00:53:24 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1C764160AB1 for ; Thu, 11 Aug 2016 02:53:23 +0200 (CEST) Received: (qmail 42394 invoked by uid 500); 11 Aug 2016 00:53:23 -0000 Mailing-List: contact dev-help@atlas.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.incubator.apache.org Delivered-To: mailing list dev@atlas.incubator.apache.org Received: (qmail 42382 invoked by uid 99); 11 Aug 2016 00:53:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2016 00:53:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id D8DE11A5259 for ; Thu, 11 Aug 2016 00:53:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.646 X-Spam-Level: X-Spam-Status: No, score=-4.646 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.426] autolearn=disabled Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id r0zJzrw3xRiG for ; Thu, 11 Aug 2016 00:53:22 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id DE29B5F242 for ; Thu, 11 Aug 2016 00:53:21 +0000 (UTC) Received: (qmail 42206 invoked by uid 99); 11 Aug 2016 00:53:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Aug 2016 00:53:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id C9FC32C02A6 for ; Thu, 11 Aug 2016 00:53:20 +0000 (UTC) Date: Thu, 11 Aug 2016 00:53:20 +0000 (UTC) From: "Suma Shivaprasad (JIRA)" To: dev@atlas.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (ATLAS-1111) Data loss is observed when atlas is restarted while hive_table metadata ingestion into kafka topic is in-progress MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 11 Aug 2016 00:53:25 -0000 [ https://issues.apache.org/jira/browse/ATLAS-1111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated ATLAS-1111: ------------------------------------ Attachment: ATLAS-1111.1.patch Fixed failing tests in webapp > Data loss is observed when atlas is restarted while hive_table metadata ingestion into kafka topic is in-progress > ----------------------------------------------------------------------------------------------------------------- > > Key: ATLAS-1111 > URL: https://issues.apache.org/jira/browse/ATLAS-1111 > Project: Atlas > Issue Type: Bug > Reporter: Sharmadha Sainath > Priority: Critical > Fix For: 0.8-incubating > > Attachments: ATLAS-1111.1.patch, ATLAS-1111.patch > > > During atlas stop, the graph is shutdown first and then the services like NotificationHookConsumer is shutdown. After graph is shutdown and before NotificationHookConsumer is shutdown, the message handling fails as the graph is down, but the NotificationHookConsumer commits the message(updating the offset). So, the messages during this time are lost -- This message was sent by Atlassian JIRA (v6.3.4#6332)