Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B8D4911B11 for ; Fri, 18 Apr 2014 17:50:04 +0000 (UTC) Received: (qmail 69237 invoked by uid 500); 18 Apr 2014 17:50:02 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 69189 invoked by uid 500); 18 Apr 2014 17:50:01 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 69181 invoked by uid 99); 18 Apr 2014 17:50:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Apr 2014 17:50:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of skhannit@gmail.com designates 209.85.220.44 as permitted sender) Received: from [209.85.220.44] (HELO mail-pa0-f44.google.com) (209.85.220.44) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Apr 2014 17:49:56 +0000 Received: by mail-pa0-f44.google.com with SMTP id bj1so1682046pad.3 for ; Fri, 18 Apr 2014 10:49:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=YZWaC6tcrztX3LcctWibIKWXlDPMz4IT6/KIm9ZrPus=; b=zY5zextyKt+O1fwVudhor1uxmWFRi+ZUoaqISuECeW8ZNZfxAIEJc8bNkpSnRmmPh7 JRrnlZ2/42x77AYStZi7uFO8hp1HZtj0e+HJuFxPuVJt+4EIZWvE0n1/KsyHXX6U0TNS YSQLQ7fvjieAbiMrgoFqjAAXaO744SuWqhoT1IdAnyk6zfAOOaFPztTXEvq8PfbszRK2 kIIhpsI7ZXPzs1+0a8wOCXhtTMc/5TZra+pb/+O8tUfk0au/YI2ZyG/myIbiu8++wdzU NS/dUPLI9elrhK1piKNBfm1SGZUf+tuyOLG+BnLdhQY8wsmew9+jO8J3HszeNQW5NuGg fmYA== MIME-Version: 1.0 X-Received: by 10.66.148.134 with SMTP id ts6mr23159237pab.113.1397843375875; Fri, 18 Apr 2014 10:49:35 -0700 (PDT) Received: by 10.66.181.109 with HTTP; Fri, 18 Apr 2014 10:49:35 -0700 (PDT) Date: Fri, 18 Apr 2014 13:49:35 -0400 Message-ID: Subject: Indexing in Hive From: saquib khan To: user@hive.apache.org Content-Type: multipart/alternative; boundary=047d7b678300deece304f754c51d X-Virus-Checked: Checked by ClamAV on apache.org --047d7b678300deece304f754c51d Content-Type: text/plain; charset=UTF-8 Hi, For large tables, its takes a lot of time to load the indexes in the index table. Is there any way we can reduce the index load time? CREATE TABLE SE_TX_SUMMARY (COUNTY string, BLOCKGROUPID string, GROUPING_ID int) PARTITIONED BY (EXPOSED_TIME int) row format delimited fields terminated by '|' stored as textfile; CREATE INDEX se_vt_summary_county_index ON TABLE se_vt_summary (exposed_time) AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD; ALTER INDEX se_vt_county_index ON se_vt REBUILD; Thanks and Regards, Saquib --047d7b678300deece304f754c51d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

For large tables, its takes a lot o= f time to load the indexes in the index table. Is there any way we can redu= ce the index load time?


CREATE= TABLE SE_TX_SUMMARY (COUNTY string, BLOCKGROUPID string, GROUPING_ID int) = PARTITIONED BY (EXPOSED_TIME int) row format delimited fields terminated by= '|' stored as textfile;
=C2=A0
=C2=A0=C2=A0
=C2=A0CREATE INDEX se_vt_summa= ry_county_index ON TABLE se_vt_summary (exposed_time) AS 'org.apache.ha= doop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD;<= /div>

ALTER INDEX =C2=A0se_vt_county_index ON se_vt REBUILD;

Thanks and Regards,
Saquib

=

--047d7b678300deece304f754c51d--