Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AEA2D18655 for ; Mon, 24 Aug 2015 23:12:04 +0000 (UTC) Received: (qmail 60679 invoked by uid 500); 24 Aug 2015 23:12:02 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 60604 invoked by uid 500); 24 Aug 2015 23:12:02 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 60594 invoked by uid 99); 24 Aug 2015 23:12:02 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Aug 2015 23:12:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 476B0182355 for ; Mon, 24 Aug 2015 23:12:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.898 X-Spam-Level: ** X-Spam-Status: No, score=2.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id vdIubVI6XpTk for ; Mon, 24 Aug 2015 23:12:01 +0000 (UTC) Received: from mail-yk0-f175.google.com (mail-yk0-f175.google.com [209.85.160.175]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 67FD442B16 for ; Mon, 24 Aug 2015 23:12:01 +0000 (UTC) Received: by ykll84 with SMTP id l84so137879045ykl.0 for ; Mon, 24 Aug 2015 16:11:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=KR1LP7MGIau0Kqva/UDz+ym2Nfw9yRAr3YF1H3WS6Zo=; b=arGSTrLCq4EupP/Mnfw1MEG9FwN/dlJrVjdWo2X/Tesy06y+pnPRIf8/tEpLBDlAX4 n9IVMzvIBMsp4M29yVoHN+AVCwyJKV8lkkgAHCKgtq05byNkmPIMLsfgQpM7LIk6PXmM PamZVkEHif9/C7x5wCo//CigpWipS/amPMk1hK103bobRNOY03vkEgY5FIF4/XaHhaBY MBKBxXsn1sC9fQptHN6i/8yCFxhwVg+7s17sKhbNPYLcIJR5SNj8SEtXqL8Yt1UmdgC+ VzwcqEKcefvg3MAyrPjAqdTx7SFbwjJ6khGZnprd6H8wgWF5Cfgxw3XjDWhhui+5g68w bjfw== MIME-Version: 1.0 X-Received: by 10.129.129.69 with SMTP id r66mr12241156ywf.167.1440457914666; Mon, 24 Aug 2015 16:11:54 -0700 (PDT) Received: by 10.129.82.9 with HTTP; Mon, 24 Aug 2015 16:11:54 -0700 (PDT) Date: Mon, 24 Aug 2015 16:11:54 -0700 Message-ID: Subject: Data Deleted on Hive External Table From: Peyman Mohajerian To: user@hive.apache.org Content-Type: multipart/alternative; boundary=94eb2c0812f05153cb051e16bebd --94eb2c0812f05153cb051e16bebd Content-Type: text/plain; charset=UTF-8 Hi Guys, I managed to delete some data in HDFS by dropping a partitioned external Hive table. One explanation is that data resided in the 'warehouse' directory of Hive and that had something to do with? An alternative explanation may that my 'drop table' statement didn't delete the data but my follow up 'create table' statement with a different partition name did. Let me elaborate, files used to be in this directory structure: /user/hive/warehouse//year=2009 I created a new Hive external table with partition column name of 'yr' instead of 'year' pointing to the same base directory. Is it possible that this create statement deleted the data (highly doubt that)? Either case were unexpected to me! This is on Hive 1.0. Thanks, Peyman --94eb2c0812f05153cb051e16bebd Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Guys,

I managed to delete some data = in HDFS by dropping a partitioned external Hive table. One explanation is t= hat data resided in the 'warehouse' directory of Hive and that had = something to do with?
An alternative explanation may that my '= ;drop table' statement didn't delete the data but my follow up '= ;create table' statement with a different partition name did. Let me el= aborate, files used to be in this directory structure:
/user/hive= /warehouse/<tablename>/year=3D2009=C2=A0

I c= reated a new Hive external table with partition column name of 'yr'= instead of 'year' pointing to the same base directory. Is it possi= ble that this create statement deleted the data (highly doubt that)? Either= case were unexpected to me!

This is on Hive 1.0.<= /div>

Thanks,
Peyman
--94eb2c0812f05153cb051e16bebd--