drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victoria Markman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3729) Remove info message about invalid argument during query planning where filter is a directory
Date Tue, 01 Sep 2015 00:52:46 GMT
Victoria Markman created DRILL-3729:
---------------------------------------

             Summary: Remove info message about invalid argument during query planning where
filter is a directory
                 Key: DRILL-3729
                 URL: https://issues.apache.org/jira/browse/DRILL-3729
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Victoria Markman


I hit this INFO/exception during query planning. 
It sounds like that we are treating directory (2015) as if it was a parquet file.  It would
be nice to get rid of an exception in the log file - it is misleading.

{code}
explain plan for select l_orderkey from dfs.`/drill/testdata/adt/lineitem` l1  where l1.dir0
= '2015'
{code}

{code}
2015-08-31 23:36:15,714 [2a1b1b0f-a703-2f9b-8697-8997d5ca00b1:foreman] INFO  o.a.d.e.store.mock.MockStorageEngine
- Failure while attempting to check for Parquet metadata file.
java.io.IOException: Open failed for file: /drill/testdata/adt/lineitem/2015, error: Invalid
argument (22)
        at com.mapr.fs.MapRClientImpl.open(MapRClientImpl.java:212) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr]
        at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:853) ~[maprfs-4.1.0-mapr.jar:4.1.0-mapr]
        at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:800) ~[hadoop-common-2.5.1-mapr-1503.jar:na]
        at org.apache.drill.exec.store.dfs.DrillFileSystem.open(DrillFileSystem.java:128)
~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.BasicFormatMatcher$MagicStringMatcher.matches(BasicFormatMatcher.java:139)
~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.BasicFormatMatcher.isReadable(BasicFormatMatcher.java:108)
~[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isDirReadable(ParquetFormatPlugin.java:226)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.parquet.ParquetFormatPlugin$ParquetFormatMatcher.isReadable(ParquetFormatPlugin.java:206)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:291)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.create(WorkspaceSchemaFactory.java:118)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.getNewEntry(ExpandingConcurrentMap.java:96)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.ExpandingConcurrentMap.get(ExpandingConcurrentMap.java:90)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.WorkspaceSchemaFactory$WorkspaceSchema.getTable(WorkspaceSchemaFactory.java:241)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.store.dfs.FileSystemSchemaFactory$FileSystemSchema.getTable(FileSystemSchemaFactory.java:117)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.calcite.jdbc.SimpleCalciteSchema.getTable(SimpleCalciteSchema.java:83)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.prepare.CalciteCatalogReader.getTableFrom(CalciteCatalogReader.java:116)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:99)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.prepare.CalciteCatalogReader.getTable(CalciteCatalogReader.java:70)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.EmptyScope.getTableNamespace(EmptyScope.java:75)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.DelegatingScope.getTableNamespace(DelegatingScope.java:124)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:104)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2776)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:2761)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2984)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:86)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:876)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:862)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:210) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:836)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:550)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.prepare.PlannerImpl.validate(PlannerImpl.java:177) [calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.calcite.prepare.PlannerImpl.validateAndGetType(PlannerImpl.java:188)
[calcite-core-1.4.0-drill-r0.jar:1.4.0-drill-r0]
        at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateNode(DefaultSqlHandler.java:431)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.handlers.DefaultSqlHandler.validateAndConvert(DefaultSqlHandler.java:191)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.handlers.ExplainHandler.getPlan(ExplainHandler.java:56)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan(DrillSqlWorker.java:178)
[drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.work.foreman.Foreman.runSQL(Foreman.java:903) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:242) [drill-java-exec-1.2.0-SNAPSHOT.jar:1.2.0-SNAPSHOT]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_71]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message