Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3FAE628C for ; Tue, 19 Jul 2011 18:39:25 +0000 (UTC) Received: (qmail 56487 invoked by uid 500); 19 Jul 2011 18:39:25 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 56418 invoked by uid 500); 19 Jul 2011 18:39:24 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 56399 invoked by uid 500); 19 Jul 2011 18:39:24 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 56391 invoked by uid 99); 19 Jul 2011 18:39:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jul 2011 18:39:24 +0000 X-ASF-Spam-Status: No, hits=-2001.1 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Jul 2011 18:39:19 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8042A44FEA for ; Tue, 19 Jul 2011 18:38:59 +0000 (UTC) Date: Tue, 19 Jul 2011 18:38:59 +0000 (UTC) From: "jiraposter@reviews.apache.org (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <1474259125.4856.1311100739522.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <742954172.77837.1303530185732.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HIVE-2128) Automatic Indexing with multiple tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067878#comment-13067878 ] jiraposter@reviews.apache.org commented on HIVE-2128: ----------------------------------------------------- ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1010/#review1112 ----------------------------------------------------------- ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexQueryContext.java Why was this comment truncated? ql/src/test/queries/clientpositive/index_auto_mult_tables.q All of these SELECT statements need ORDER BY for determinism. - John On 2011-07-19 03:15:17, Syed Albiz wrote: bq. bq. ----------------------------------------------------------- bq. This is an automatically generated e-mail. To reply, visit: bq. https://reviews.apache.org/r/1010/ bq. ----------------------------------------------------------- bq. bq. (Updated 2011-07-19 03:15:17) bq. bq. bq. Review request for hive and John Sichi. bq. bq. bq. Summary bq. ------- bq. bq. Grab the indexed tables during optimized query generation, grab the associated path URIs, and keep those around in the Configuration object. When the job is passed to ExecDriver, this data is extracted and used in HiveIndexedInputFormat to decide whether to use the index file or delegate to the parent (HiveInputFormat) class. Not sure if this is robust. bq. bq. bq. This addresses bug HIVE-2128. bq. https://issues.apache.org/jira/browse/HIVE-2128 bq. bq. bq. Diffs bq. ----- bq. bq. ql/src/test/results/clientpositive/index_auto_self_join.q.out PRE-CREATION bq. ql/src/test/results/clientpositive/index_auto_mult_tables_compact.q.out PRE-CREATION bq. ql/src/test/queries/clientpositive/index_auto_self_join.q PRE-CREATION bq. ql/src/test/results/clientpositive/index_auto_mult_tables.q.out PRE-CREATION bq. ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java a03a9a6 bq. ql/src/test/queries/clientpositive/index_auto_mult_tables.q PRE-CREATION bq. ql/src/test/queries/clientpositive/index_auto_mult_tables_compact.q PRE-CREATION bq. ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexResult.java b9b586e bq. ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexedInputFormat.java f1ee95d bq. ql/src/java/org/apache/hadoop/hive/ql/index/bitmap/BitmapIndexHandler.java 61bbbf5 bq. ql/src/java/org/apache/hadoop/hive/ql/index/compact/CompactIndexHandler.java 7c91946 bq. ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/index/IndexWhereProcessor.java dbc489f bq. ql/src/java/org/apache/hadoop/hive/ql/index/HiveIndexQueryContext.java 617723e bq. bq. Diff: https://reviews.apache.org/r/1010/diff bq. bq. bq. Testing bq. ------- bq. bq. added new testcase index_auto_mult_tables.q bq. bq. bq. Thanks, bq. bq. Syed bq. bq. > Automatic Indexing with multiple tables > --------------------------------------- > > Key: HIVE-2128 > URL: https://issues.apache.org/jira/browse/HIVE-2128 > Project: Hive > Issue Type: Improvement > Components: Indexing > Affects Versions: 0.8.0 > Reporter: Russell Melick > Assignee: Syed S. Albiz > Attachments: HIVE-2128.1.patch, HIVE-2128.1.patch, HIVE-2128.2.patch, HIVE-2128.4.patch, HIVE-2128.5.patch > > > Make automatic indexing work with jobs which access multiple tables. We'll probably need to modify the way that the index input format works in order to associate index formats/files with specific tables. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira