Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 724DB200CF9 for ; Sun, 17 Sep 2017 20:29:04 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 70BF21609D8; Sun, 17 Sep 2017 18:29:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B6EC41609CF for ; Sun, 17 Sep 2017 20:29:03 +0200 (CEST) Received: (qmail 77470 invoked by uid 500); 17 Sep 2017 18:29:02 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 77461 invoked by uid 99); 17 Sep 2017 18:29:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Sep 2017 18:29:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 7AFB71A104B for ; Sun, 17 Sep 2017 18:29:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id QKmm-HyjANrV for ; Sun, 17 Sep 2017 18:29:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 203CA5F397 for ; Sun, 17 Sep 2017 18:29:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 57FF2E010F for ; Sun, 17 Sep 2017 18:29:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 0EA3024143 for ; Sun, 17 Sep 2017 18:29:00 +0000 (UTC) Date: Sun, 17 Sep 2017 18:29:00 +0000 (UTC) From: "Tao Li (JIRA)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HIVE-17422) Skip non-native/temporary tables for all major table/partition related scenarios MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sun, 17 Sep 2017 18:29:04 -0000 [ https://issues.apache.org/jira/browse/HIVE-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-17422: -------------------------- Status: Patch Available (was: Open) > Skip non-native/temporary tables for all major table/partition related scenarios > -------------------------------------------------------------------------------- > > Key: HIVE-17422 > URL: https://issues.apache.org/jira/browse/HIVE-17422 > Project: Hive > Issue Type: Improvement > Components: repl > Reporter: Tao Li > Assignee: Tao Li > Attachments: HIVE-17422.1.patch, HIVE-17422.2.patch, HIVE-17422.3.patch, HIVE-17422.4.patch > > > Currently during incremental dump, the non-native/temporary table info is partially dumped in metadata file and will be ignored later by the repl load. We can optimize it by moving the check (whether the table should be exported or not) earlier so that we don't save any info to dump file for such types of tables. CreateTableHandler already has this optimization, so we just need to apply similar logic to other scenarios. > The change is to apply the EximUtil.shouldExportTable check to all scenarios (e.g. alter table) that calls into the common dump method. -- This message was sent by Atlassian JIRA (v6.4.14#64029)