Return-Path: X-Original-To: apmail-impala-dev-archive@minotaur.apache.org Delivered-To: apmail-impala-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CB8A418168 for ; Fri, 11 Mar 2016 20:36:32 +0000 (UTC) Received: (qmail 9932 invoked by uid 500); 11 Mar 2016 20:36:32 -0000 Delivered-To: apmail-impala-dev-archive@impala.apache.org Received: (qmail 9890 invoked by uid 500); 11 Mar 2016 20:36:32 -0000 Mailing-List: contact dev-help@impala.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@impala.incubator.apache.org Delivered-To: mailing list dev@impala.incubator.apache.org Received: (qmail 9879 invoked by uid 99); 11 Mar 2016 20:36:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Mar 2016 20:36:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 0E3081A05CF for ; Fri, 11 Mar 2016 20:36:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.362 X-Spam-Level: X-Spam-Status: No, score=0.362 tagged_above=-999 required=6.31 tests=[RDNS_DYNAMIC=0.363, SPF_PASS=-0.001] autolearn=disabled Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 5X1oT-4wnj8c for ; Fri, 11 Mar 2016 20:36:30 +0000 (UTC) Received: from ip-10-146-233-104.ec2.internal (ec2-75-101-130-251.compute-1.amazonaws.com [75.101.130.251]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id F039A5FB23 for ; Fri, 11 Mar 2016 20:36:29 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by ip-10-146-233-104.ec2.internal (8.14.4/8.14.4) with ESMTP id u2BKaSpJ012810; Fri, 11 Mar 2016 20:36:28 GMT Message-Id: <201603112036.u2BKaSpJ012810@ip-10-146-233-104.ec2.internal> Date: Fri, 11 Mar 2016 20:36:27 +0000 From: "Dimitris Tsirogiannis (Code Review)" To: Jim Apple , impala-cr@cloudera.com, dev@impala.incubator.apache.org Reply-To: dtsirogiannis@cloudera.com X-Gerrit-MessageType: comment Subject: =?UTF-8?Q?[Impala-CR](cdh5-trunk)_IMPALA-1903:_Add_support_for_partitioning_by_TIMESTAMP=0A?= X-Gerrit-Change-Id: Icad7dcdc1b199cce9483dc414072bbe24efd625c X-Gerrit-ChangeURL: X-Gerrit-Commit: 611eb4bd51740b0f4864d9f359a37edc8e6434cc In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.10-rc0 Dimitris Tsirogiannis has posted comments on this change. Change subject: IMPALA-1903: Add support for partitioning by TIMESTAMP ...................................................................... Patch Set 5: (11 comments) Minor comments. The main issue left is the behavior when invalid timestamp values are used. http://gerrit.cloudera.org:8080/#/c/1621/5//COMMIT_MSG Commit Message: Line 17: it missing nit: "is" is missing :) http://gerrit.cloudera.org:8080/#/c/1621/5/be/src/exprs/expr-test.cc File be/src/exprs/expr-test.cc: Line 5509: TestValue("nonnullvalue(cast('2010-01-01' as timestamp))", TYPE_BOOLEAN, true); For completion, let's also add one timestamp with date and time but without the fractional part. http://gerrit.cloudera.org:8080/#/c/1621/5/be/src/runtime/timestamp-parse-util.h File be/src/runtime/timestamp-parse-util.h: Line 359: CheckParse Or maybe ParseTimestamp? http://gerrit.cloudera.org:8080/#/c/1621/5/common/thrift/Types.thrift File common/thrift/Types.thrift: Line 24: unrelated enums Such as? http://gerrit.cloudera.org:8080/#/c/1621/5/fe/src/main/java/com/cloudera/impala/analysis/LiteralExpr.java File fe/src/main/java/com/cloudera/impala/analysis/LiteralExpr.java: Line 126: result = new TimestampLiteral(exprNode.timestamp_literal.value); Why don't you call the LiteralExpr.create() as we do in the other cases? http://gerrit.cloudera.org:8080/#/c/1621/5/fe/src/main/java/com/cloudera/impala/analysis/TimestampLiteral.java File fe/src/main/java/com/cloudera/impala/analysis/TimestampLiteral.java: Line 84: public int compareTo(LiteralExpr o) As we discussed offline, let's remove this. http://gerrit.cloudera.org:8080/#/c/1621/5/fe/src/main/java/com/cloudera/impala/catalog/ScalarType.java File fe/src/main/java/com/cloudera/impala/catalog/ScalarType.java: Line 278: if (!isSupported() || isComplexType()) { : return false; : } nit: single line http://gerrit.cloudera.org:8080/#/c/1621/5/fe/src/main/java/com/cloudera/impala/planner/DataSourceScanNode.java File fe/src/main/java/com/cloudera/impala/planner/DataSourceScanNode.java: Line 136: // TODO: we support DECIMAL but no way to specify it in SQL. I am not sure I understand what this TODO means. Can you check with Alex or maybe MJ? http://gerrit.cloudera.org:8080/#/c/1621/5/fe/src/test/java/com/cloudera/impala/analysis/AnalyzeDDLTest.java File fe/src/test/java/com/cloudera/impala/analysis/AnalyzeDDLTest.java: Line 1262: nit: remove empty line http://gerrit.cloudera.org:8080/#/c/1621/5/testdata/workloads/functional-query/queries/QueryTest/timestamp-partitions.test File testdata/workloads/functional-query/queries/QueryTest/timestamp-partitions.test: Line 29: select * from t : where ts != '1999-12-31'; If they fit, can you put each statement in a single line? http://gerrit.cloudera.org:8080/#/c/1621/5/tests/metadata/test_recover_partitions.py File tests/metadata/test_recover_partitions.py: Line 209: nit: extra space -- To view, visit http://gerrit.cloudera.org:8080/1621 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: Icad7dcdc1b199cce9483dc414072bbe24efd625c Gerrit-PatchSet: 5 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Jim Apple Gerrit-Reviewer: Dimitris Tsirogiannis Gerrit-Reviewer: Jim Apple Gerrit-HasComments: Yes