Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BE086DE9E for ; Wed, 12 Sep 2012 20:06:47 +0000 (UTC) Received: (qmail 7760 invoked by uid 500); 12 Sep 2012 20:06:46 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 7717 invoked by uid 500); 12 Sep 2012 20:06:46 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 7709 invoked by uid 99); 12 Sep 2012 20:06:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 12 Sep 2012 20:06:46 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_FREEMAIL_1,FSL_FREEMAIL_2,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,UNPARSEABLE_RELAY X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.138.90.251] (HELO nm5-vm0.bullet.mail.ne1.yahoo.com) (98.138.90.251) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 12 Sep 2012 20:06:36 +0000 Received: from [98.138.90.50] by nm5.bullet.mail.ne1.yahoo.com with NNFMP; 12 Sep 2012 20:06:14 -0000 Received: from [98.138.226.161] by tm3.bullet.mail.ne1.yahoo.com with NNFMP; 12 Sep 2012 20:06:14 -0000 Received: from [127.0.0.1] by omp1062.mail.ne1.yahoo.com with NNFMP; 12 Sep 2012 20:06:14 -0000 X-Yahoo-Newman-Id: 505970.55044.bm@omp1062.mail.ne1.yahoo.com Received: (qmail 7615 invoked from network); 12 Sep 2012 20:06:13 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=DKIM-Signature:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:Received:X-rim-org-msg-ref-id:Message-ID:Reply-To:X-Priority:References:In-Reply-To:Sensitivity:Importance:Subject:To:From:Date:Content-Type:MIME-Version; b=UzCfcKjxOJo9Vpj/mYasnyiFgQJ0SHu0wrN4UvFj+iGL6dUYZqVkoIIagjufbnj0wkFP8XCAKf+KJ12uqkw4806M4RBWs8pqi8qMg4CNzSro83RgDa3vSzqeI7jkjf+QXVlTPJPl0CogwOxpOOyKmDfxi+tlQTZ6VC3sQJ8/9w4= ; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1347480373; bh=NNFhPX9XKQEEonAVjR2lOihqtFzDxm1qs5GTiODv0eE=; h=X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:Received:X-rim-org-msg-ref-id:Message-ID:Reply-To:X-Priority:References:In-Reply-To:Sensitivity:Importance:Subject:To:From:Date:Content-Type:MIME-Version; b=j9fmx0NYfP5kN0263bJHO8+5H2gqXDinAbfyGG8Z88Qk/DfHMHNPbLnp1iJHvf3dM3ellRzqrEu+ysMBNL/1dlrHh54yEZlGzYQ4wEDLXVTZ5DVEBCt3yBYWDQoZCKxj/mafWdujBcUT1cuhggiGANEppyd9zS1RrXy4AbaqyEw= X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: PGSJSYkVM1lT0tJY0KoQaDeIWIwknMBNWKW92NiqDZpO13C J6seSDAea7Hkxu5ovshY40kMleIG5whCvizT9oQptlwm3o1bMoQTuJm7_eST o8okKUVmJLP7oJM8ODyIY5W4YClBs5oG1mRC98OEVhVsW0rLTAnYvXwZASJs e3sX8UkqQ7LGOjvJAO6p7fwqR68iCMYrbeyxx11YVndaJxdaZC3SLt6dY.ed .2gjXq_LU33YMvBAmmPSd4PeFPERzWMw0eKAI70wIDZkIyq0HeQ3_GTAvy1x slTEBCq85mvt5ADAh613ZXkxf8_e1OPcEAWfqGV4_NMwX8BCVMZjcoB5_wux FDjkSHh34Mpp.WAidTNqJMU.3cB_FxurgHAyDs.DSlIMB1hX0RLHMip6WG2t oG2ynn_BJ X-Yahoo-SMTP: fUyZ91eswBBme0tpFWJ5iyHn6M7J Received: from b2.c15.bise7.blackberry (bejoy_ks@178.239.86.185 with xymcookie) by smtp118-mob.biz.mail.gq1.yahoo.com with SMTP; 12 Sep 2012 13:06:13 -0700 PDT X-rim-org-msg-ref-id: 176434608 Message-ID: <176434608-1347480368-cardhu_decombobulator_blackberry.rim.net-1838632827-@b25.c15.bise7.blackberry> Reply-To: bejoy_ks@yahoo.com X-Priority: Normal References: In-Reply-To: Sensitivity: Normal Importance: Normal Subject: Re: most efficient way to concatenate 3 tables into one? To: user@hive.apache.org From: "Bejoy KS" Date: Wed, 12 Sep 2012 20:06:13 +0000 Content-Type: multipart/alternative; boundary="part35-boundary-436370583-1284005141" MIME-Version: 1.0 --part35-boundary-436370583-1284005141 Content-Type: text/plain; charset="Windows-1252" Hi If all the 3 tables have the same. Schema, Create an external table and move the data from all the 3 tables to this new table's location. Just a hdfs copy or move is not that expensive. Regards Bejoy KS Sent from handheld, please excuse typos. -----Original Message----- From: zuohua zhang Date: Wed, 12 Sep 2012 13:02:42 To: Reply-To: user@hive.apache.org Subject: most efficient way to concatenate 3 tables into one? I have 3 tables, each contains monthly data, I would like to make a table to concatenate all 3 months into 1 table. What is the most efficient way to do that? I am using insert into which takes a long time. Thanks! --part35-boundary-436370583-1284005141 Content-Transfer-Encoding: base64 Content-Type: text/html; charset="Windows-1252" PCFET0NUWVBFIGh0bWwgUFVCTElDICItLy9XM0MvL0RURCBIVE1MIDQuMCBUcmFuc2l0aW9uYWwv L0VOIj48aHRtbD48aGVhZD48bWV0YSBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgi IGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSI+PC9oZWFkPjxib2R5PkhpPGJyLz48YnIvPklmIGFs bCB0aGUgMyB0YWJsZXMgaGF2ZSB0aGUgc2FtZS4gU2NoZW1hLCBDcmVhdGUgYW4gZXh0ZXJuYWwg dGFibGUgYW5kIG1vdmUgdGhlIGRhdGEgZnJvbSBhbGwgdGhlIDMgdGFibGVzIHRvIHRoaXMgbmV3 IHRhYmxlJ3MgbG9jYXRpb24uIEp1c3QgYSBoZGZzIGNvcHkgb3IgbW92ZSBpcyBub3QgdGhhdCBl eHBlbnNpdmUuPGJyLz48ZGl2PlJlZ2FyZHM8YnIvPkJlam95IEtTPGJyLz48YnIvPlNlbnQgZnJv bSBoYW5kaGVsZCwgcGxlYXNlIGV4Y3VzZSB0eXBvcy48L2Rpdj48aHIvPjxkaXY+PGI+RnJvbTog PC9iPiB6dW9odWEgemhhbmcgJmx0O3p1b2h1YUBnbWFpbC5jb20mZ3Q7DQo8L2Rpdj48ZGl2Pjxi PkRhdGU6IDwvYj5XZWQsIDEyIFNlcCAyMDEyIDEzOjAyOjQyIC0wNzAwPC9kaXY+PGRpdj48Yj5U bzogPC9iPiZsdDt1c2VyQGhpdmUuYXBhY2hlLm9yZyZndDs8L2Rpdj48ZGl2PjxiPlJlcGx5VG86 IDwvYj4gdXNlckBoaXZlLmFwYWNoZS5vcmcNCjwvZGl2PjxkaXY+PGI+U3ViamVjdDogPC9iPm1v c3QgZWZmaWNpZW50IHdheSB0byBjb25jYXRlbmF0ZSAzIHRhYmxlcyBpbnRvIG9uZT88L2Rpdj48 ZGl2Pjxici8+PC9kaXY+SSBoYXZlIDMgdGFibGVzLCBlYWNoIGNvbnRhaW5zIG1vbnRobHkgZGF0 YSwgSSB3b3VsZCBsaWtlIHRvIG1ha2UgYSB0YWJsZSB0byBjb25jYXRlbmF0ZSBhbGwgMyBtb250 aHMgaW50byAxIHRhYmxlLqA8ZGl2PldoYXQgaXMgdGhlIG1vc3QgZWZmaWNpZW50IHdheSB0byBk byB0aGF0PzwvZGl2PjxkaXY+SSBhbSB1c2luZyBpbnNlcnQgaW50byB3aGljaCB0YWtlcyBhIGxv bmcgdGltZS48L2Rpdj4NCjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzITwvZGl2Pg0KDQo8L2Jv ZHk+PC9odG1sPg== --part35-boundary-436370583-1284005141--