Return-Path: X-Original-To: apmail-drill-issues-archive@minotaur.apache.org Delivered-To: apmail-drill-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9C85210CAB for ; Tue, 1 Sep 2015 00:52:46 +0000 (UTC) Received: (qmail 48034 invoked by uid 500); 1 Sep 2015 00:52:46 -0000 Delivered-To: apmail-drill-issues-archive@drill.apache.org Received: (qmail 47925 invoked by uid 500); 1 Sep 2015 00:52:46 -0000 Mailing-List: contact issues-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@drill.apache.org Delivered-To: mailing list issues@drill.apache.org Received: (qmail 47911 invoked by uid 99); 1 Sep 2015 00:52:46 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Sep 2015 00:52:46 +0000 Date: Tue, 1 Sep 2015 00:52:46 +0000 (UTC) From: "Victoria Markman (JIRA)" To: issues@drill.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (DRILL-3729) Remove info message about invalid argument during query planning where filter is a directory MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Victoria Markman created DRILL-3729: --------------------------------------- Summary: Remove info message about invalid argument during query planning where filter is a directory Key: DRILL-3729 URL: https://issues.apache.org/jira/browse/DRILL-3729 Project: Apache Drill Issue Type: Bug Reporter: Victoria Markman I hit this INFO/exception during query planning. It sounds like that we are treating directory (2015) as if it was a parquet file. It would be nice to get rid of an exception in the log file - it is misleading. {code} explain plan for select l_orderkey from dfs.`/drill/testdata/adt/lineitem` l1 where l1.dir0 = '2015' {code} {code} 2015-08-31 23:36:15,714 [2a1b1b0f-a703-2f9b-8697-8997d5ca00b1:foreman] INFO o.a.d.e.store.mock.MockStorageEngine - Failure while attempting to check for Parquet metadata file. java.io.IOException: Open failed for file: /drill/testdata/adt/lineitem/2015, error: Invalid argument (22) at com.mapr.fs.MapRClientImpl.open(MapRClientImpl.java:212) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr] at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:853) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr] at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:800) ~[hadoop-common-2.5.1-mapr-1503.jar:na] at org.apache.drill.exec.store.dfs.DrillFileSystem.open(DrillFileSystem.java:128) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.BasicFormatMatcher$MagicStringMatcher.matches(BasicFormatMatcher.java:139) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.BasicFormatMatcher.isReadable(BasicFormatMatcher.java:108) ~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isDirReadable(ParquetFormatPlugin.java:226) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isReadable(ParquetFormatPlugin.java:206) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:291) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:118) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.getNewEntry(ExpandingConcurrentMap.java:96) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.get(ExpandingConcurrentMap.java:90) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.getTable(WorkspaceSchemaFactory.java:241) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.store.dfs.FileSystemSchemaFactory$FileSystemSchema.getTable(FileSystemSchemaFactory.java:117) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.calcite.jdbc.SimpleCalciteSchema.getTable(SimpleCalciteSchema.java:83) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:116) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:99) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:70) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:75) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:124) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2776) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2761) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2984) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:210) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:836) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:550) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.prepare.PlannerImpl.validate(PlannerImpl.java:177) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.calcite.prepare.PlannerImpl.validateAndGetType(PlannerImpl.java:188) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0] at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:431) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:191) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.planner.sql.handlers.ExplainHandler.getPlan(ExplainHandler.java:56) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:178) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:903) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:242) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_71] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_71] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71] {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)