Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9BFEE18C36 for ; Fri, 10 Jul 2015 05:24:50 +0000 (UTC) Received: (qmail 49587 invoked by uid 500); 10 Jul 2015 05:24:50 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 49503 invoked by uid 500); 10 Jul 2015 05:24:50 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 49490 invoked by uid 99); 10 Jul 2015 05:24:49 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 10 Jul 2015 05:24:49 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 7DAACBB53F; Fri, 10 Jul 2015 05:24:49 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============5323988761018108792==" MIME-Version: 1.0 Subject: Review Request 36386: Auto-gather column stats From: "pengcheng xiong" To: "John Pullokkaran" Cc: "pengcheng xiong" , "hive" Date: Fri, 10 Jul 2015 05:24:49 -0000 Message-ID: <20150710052449.1572.84742@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "pengcheng xiong" X-ReviewGroup: hive X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/36386/ X-Sender: "pengcheng xiong" Reply-To: "pengcheng xiong" X-ReviewRequest-Repository: hive-git --===============5323988761018108792== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36386/ ----------------------------------------------------------- Review request for hive and John Pullokkaran. Repository: hive-git Description ------- Hive will collect table stats when set hive.stats.autogather=true during the INSERT OVERWRITE command. And then the users need to collect the column stats themselves using "Analyze" command. In this patch, the column stats will also be collected automatically when a flag is set. Diffs ----- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 39477d6 metastore/src/java/org/apache/hadoop/hive/metastore/AggregateStatsCache.java 44106f5 ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java d688ef1 ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 3b5dbe2 ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsAutoGatherContext.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java a5f0a7f ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java 5872e8e ql/src/java/org/apache/hadoop/hive/ql/parse/QBParseInfo.java 14a7e9c ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java b02374e ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java ba11e41 ql/src/test/queries/clientpositive/autoColumnStats.q PRE-CREATION ql/src/test/results/clientpositive/autoColumnStats.q.out PRE-CREATION Diff: https://reviews.apache.org/r/36386/diff/ Testing ------- Thanks, pengcheng xiong --===============5323988761018108792==--