incubator-drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adam Szulinski <A.Szulin...@kainos.com>
Subject Running demo Drill 1.0
Date Mon, 02 Sep 2013 14:25:24 GMT
Hi,

I am trying to run demo of Drill 1.0 according to following instructions:
https://cwiki.apache.org/confluence/display/DRILL/Demo+HowTo (file version: Sep 02, 2013)
All is clear till the moment of 'Run a Query', when I'm pasting query:

"select * from "sample-data/region.parquet";"

from content of HowTo and then query fails with "java.io.FileNotFoundException: File sample-data/region.parquet
does not exist.".
It seams to be lack of parquet file. Should I get it from somewhere?
Info from console after run query:

0: jdbc:drill:schema=parquet-local> select * from "sample-data/region.parquet";
16:19:04.185 [main] DEBUG o.a.drill.optiq.EnumerableDrillRel - implementing enumerable
16:19:04.213 [main] DEBUG o.a.drill.optiq.DrillImplementor - Optiq Generated Logical Plan:
{
  "head" : {
    "type" : "APACHE_DRILL_LOGICAL",
    "version" : "1",
    "generator" : {
      "type" : "optiq",
      "info" : "na"
    }
  },
  "storage" : {
    "parquet-local" : {
      "type" : "parquet",
      "dfsName" : "file:///"
    }
  },
  "query" : [ {
    "op" : "scan",
    "memo" : "initial_scan",
    "ref" : "_MAP",
    "storageengine" : "parquet-local",
    "selection" : [ {
      "path" : "sample-data/region.parquet"
    } ],
    "@id" : 1
  }, {
    "op" : "store",
    "input" : 1,
    "storageengine" : "queue",
    "memo" : "output sink",
    "target" : {
      "number" : 0
    },
    "@id" : 2
  } ]
}
16:19:04.273 [main] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at the following
URLs [jar:file:/home/user/.m2/repository/org/apache/drill/exec/ref/1.0-SNAPSHOT/ref-1.0-SNAPSHOT.jar!/drill-module.conf,
jar:file:/home/user/.m2/repository/org/apache/drill/exec/java-exec/1.0-SNAPSHOT/java-exec-1.0-SNAPSHOT.jar!/drill-module.conf,
jar:file:/home/user/.m2/repository/org/apache/drill/common/1.0-SNAPSHOT/common-1.0-SNAPSHOT.jar!/drill-module.conf]
16:19:04.280 [main] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator sub
types: [class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Transform,
class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Store,
class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Order,
class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Segment,
class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Union,
class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Constant,
class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Scan,
class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.CollapsingAggregate]
16:19:04.281 [main] DEBUG o.a.d.c.l.StorageEngineConfigBase - Adding Storage Engine Configs
including [class org.apache.drill.exec.ref.rse.FileSystemRSE$FileSystemRSEConfig, class org.apache.drill.exec.ref.rse.ConsoleRSE$ConsoleRSEConfig,
class org.apache.drill.exec.ref.rse.QueueRSE$QueueRSEConfig, class org.apache.drill.exec.store.json.JSONStorageEngineConfig,
class org.apache.drill.exec.store.parquet.ParquetStorageEngineConfig, class org.apache.drill.exec.store.mock.MockStorageEngineConfig,
class org.apache.drill.exec.ref.rse.ClasspathRSE$ClasspathRSEConfig]
16:19:04.283 [main] DEBUG o.a.d.sql.client.full.BatchLoaderMap - Starting next query result
batch.
16:19:04.288 [WorkManager Event Thread] DEBUG o.apache.drill.exec.work.WorkManager - Starting
pending task org.apache.drill.exec.work.foreman.Foreman@297e4571
16:19:04.289 [Client-1] DEBUG o.a.d.e.rpc.user.QueryResultHandler - Received QueryId part1:
-8933707500775258587
part2: -7304718200146300837
succesfully.  Adding listener org.apache.drill.sql.client.full.BatchListener@25d2076d
16:19:04.289 [WorkManager-4] DEBUG o.a.d.e.planner.PhysicalPlanReader - Reading logical plan
{"head":{"type":"APACHE_DRILL_LOGICAL","version":"1","generator":{"type":"optiq","info":"na"}},"storage":{"parquet-local":{"type":"parquet","dfsName":"file:///"}},"query":[{"op":"scan","memo":"initial_scan","ref":"_MAP","storageengine":"parquet-local","selection":[{"path":"sample-data/region.parquet"}],"@id":1},{"op":"store","input":1,"storageengine":"queue","memo":"output
sink","target":{"number":0},"@id":2}]}
16:19:04.290 [WorkManager-4] DEBUG o.a.drill.exec.work.foreman.Foreman - Logical {
  head : {
    type : "APACHE_DRILL_LOGICAL",
    version : 1,
    generator : {
      type : "optiq",
      info : "na"
    }
  },
  storage : {
    parquet-local : {
      type : "parquet",
      dfsName : "file:///"
    }
  },
  query : [ {
    op : "scan",
    @id : 1,
    memo : "initial_scan",
   storageengine : "parquet-local",
    selection : [ {
      path : "sample-data/region.parquet"
    } ],
    ref : "_MAP"
  }, {
    op : "store",
    @id : 2,
    memo : "output sink",
    input : 1,
    target : {
      number : 0
    },
    partition : null,
    storageEngine : "queue"
  } ]
}
16:19:04.296 [WorkManager-4] DEBUG o.a.drill.common.config.DrillConfig - Loading configs at
the following URLs [jar:file:/home/user/.m2/repository/org/apache/drill/exec/ref/1.0-SNAPSHOT/ref-1.0-SNAPSHOT.jar!/drill-module.conf,
jar:file:/home/user/.m2/repository/org/apache/drill/exec/java-exec/1.0-SNAPSHOT/java-exec-1.0-SNAPSHOT.jar!/drill-module.conf,
jar:file:/home/user/.m2/repository/org/apache/drill/common/1.0-SNAPSHOT/common-1.0-SNAPSHOT.jar!/drill-module.conf]
16:19:04.317 [WorkManager-4] DEBUG o.a.d.c.l.data.LogicalOperatorBase - Adding Logical Operator
sub types: [class org.apache.drill.common.logical.data.Sequence, class org.apache.drill.common.logical.data.Transform,
class org.apache.drill.common.logical.data.Flatten, class org.apache.drill.common.logical.data.Store,
class org.apache.drill.common.logical.data.Filter, class org.apache.drill.common.logical.data.Order,
class org.apache.drill.common.logical.data.WindowFrame, class org.apache.drill.common.logical.data.Segment,
class org.apache.drill.common.logical.data.Join, class org.apache.drill.common.logical.data.Union,
class org.apache.drill.common.logical.data.Limit, class org.apache.drill.common.logical.data.Constant,
class org.apache.drill.common.logical.data.Project, class org.apache.drill.common.logical.data.Scan,
class org.apache.drill.common.logical.data.RunningAggregate, class org.apache.drill.common.logical.data.CollapsingAggregate]
16:19:04.320 [WorkManager-4] DEBUG o.a.d.c.l.StorageEngineConfigBase - Adding Storage Engine
Configs including [class org.apache.drill.exec.ref.rse.FileSystemRSE$FileSystemRSEConfig,
class org.apache.drill.exec.ref.rse.ConsoleRSE$ConsoleRSEConfig, class org.apache.drill.exec.ref.rse.QueueRSE$QueueRSEConfig,
class org.apache.drill.exec.store.json.JSONStorageEngineConfig, class org.apache.drill.exec.store.parquet.ParquetStorageEngineConfig,
class org.apache.drill.exec.store.mock.MockStorageEngineConfig, class org.apache.drill.exec.ref.rse.ClasspathRSE$ClasspathRSEConfig]
16:19:04.352 [WorkManager-4] ERROR o.a.drill.exec.work.foreman.Foreman - Error 4962bfd0-316a-43a7-af9f-9826a096c3c7:
Failure while converting logical plan to physical plan.
java.io.FileNotFoundException: File sample-data/region.parquet does not exist.
                at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)
~[hadoop-core-1.2.1.jar:na]
                at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)
~[hadoop-core-1.2.1.jar:na]
                at parquet.hadoop.ParquetFileReader.readFooters(ParquetFileReader.java:234)
~[parquet-hadoop-1.0.1.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.store.parquet.ParquetGroupScan.readFooter(ParquetGroupScan.java:131)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.store.parquet.ParquetGroupScan.<init>(ParquetGroupScan.java:119)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.store.parquet.ParquetStorageEngine.getPhysicalScan(ParquetStorageEngine.java:97)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.store.parquet.ParquetStorageEngine.getPhysicalScan(ParquetStorageEngine.java:55)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitScan(BasicOptimizer.java:189)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitScan(BasicOptimizer.java:96)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.common.logical.data.Scan.accept(Scan.java:59) ~[common-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitStore(BasicOptimizer.java:200)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.opt.BasicOptimizer$LogicalConverter.visitStore(BasicOptimizer.java:96)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.common.logical.data.Store.accept(Store.java:61) ~[common-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.opt.BasicOptimizer.optimize(BasicOptimizer.java:70)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.work.foreman.Foreman.convert(Foreman.java:242) [java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.work.foreman.Foreman.parseAndRunLogicalPlan(Foreman.java:174)
[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.work.foreman.Foreman.run(Foreman.java:153) [java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
~[na:1.7.0_25]
                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
~[na:1.7.0_25]
                at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
16:19:04.354 [WorkManager-4] DEBUG o.a.drill.exec.rpc.user.UserServer - Sending result to
client with QueryWritableBatch [header=query_state: FAILED
query_id {
  part1: -8933707500775258587
  part2: -7304718200146300837
}
is_last_chunk: true
error {
  error_id: "4962bfd0-316a-43a7-af9f-9826a096c3c7"
  endpoint {
    address: "user-VirtualBox"
    user_port: 31010
    bit_port: 31011
  }
  error_type: 0
  message: "Failure while converting logical plan to physical plan. < OptimizerException:[
Failure while attempting to retrieve storage engine. ] < FileNotFoundException:[ File sample-data/region.parquet
does not exist. ]"
}
, buffers=[]]
16:19:04.387 [main] ERROR o.a.d.s.client.full.ResultEnumerator - Exception during query
org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id: "4962bfd0-316a-43a7-af9f-9826a096c3c7"
endpoint {
  address: "user-VirtualBox"
  user_port: 31010
  bit_port: 31011
}
error_type: 0
message: "Failure while converting logical plan to physical plan. < OptimizerException:[
Failure while attempting to retrieve storage engine. ] < FileNotFoundException:[ File sample-data/region.parquet
does not exist. ]"
]
                at org.apache.drill.exec.rpc.user.QueryResultHandler.batchArrived(QueryResultHandler.java:72)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:79) ~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:48)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:33)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:142)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:127)
~[java-exec-1.0-SNAPSHOT.jar:1.0-SNAPSHOT]
                at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
~[netty-codec-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
~[netty-codec-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:173)
~[netty-codec-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:785)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:100)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:497)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:465)
~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:359) ~[netty-transport-4.0.7.Final.jar:na]
                at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
~[netty-common-4.0.7.Final.jar:na]
                at java.lang.Thread.run(Thread.java:724) ~[na:1.7.0_25]
java.lang.RuntimeException: org.apache.drill.exec.rpc.RpcException: Remote failure while running
query.[error_id: "4962bfd0-316a-43a7-af9f-9826a096c3c7"
endpoint {
  address: "user-VirtualBox"
  user_port: 31010
  bit_port: 31011
}
error_type: 0
message: "Failure while converting logical plan to physical plan. < OptimizerException:[
Failure while attempting to retrieve storage engine. ] < FileNotFoundException:[ File sample-data/region.parquet
does not exist. ]"
]
                at org.apache.drill.sql.client.full.ResultEnumerator.moveNext(ResultEnumerator.java:44)
                at net.hydromatic.optiq.runtime.ObjectEnumeratorCursor.next(ObjectEnumeratorCursor.java:44)
                at net.hydromatic.optiq.jdbc.OptiqResultSet.next(OptiqResultSet.java:162)
                at sqlline.SqlLine$BufferedRows.<init>(SqlLine.java:2499)
                at sqlline.SqlLine.print(SqlLine.java:1886)
                at sqlline.SqlLine$Commands.execute(SqlLine.java:3835)
                at sqlline.SqlLine$Commands.sql(SqlLine.java:3738)
                at sqlline.SqlLine.dispatch(SqlLine.java:882)
                at sqlline.SqlLine.begin(SqlLine.java:717)
                at sqlline.SqlLine.mainWithInputRedirection(SqlLine.java:460)
                at sqlline.SqlLine.main(SqlLine.java:443)
Caused by: org.apache.drill.exec.rpc.RpcException: Remote failure while running query.[error_id:
"4962bfd0-316a-43a7-af9f-9826a096c3c7"
endpoint {
  address: "user-VirtualBox"
  user_port: 31010
  bit_port: 31011
}
error_type: 0
message: "Failure while converting logical plan to physical plan. < OptimizerException:[
Failure while attempting to retrieve storage engine. ] < FileNotFoundException:[ File sample-data/region.parquet
does not exist. ]"
]
                at org.apache.drill.exec.rpc.user.QueryResultHandler.batchArrived(QueryResultHandler.java:72)
                at org.apache.drill.exec.rpc.user.UserClient.handle(UserClient.java:79)
                at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:48)
                at org.apache.drill.exec.rpc.BasicClientWithConnection.handle(BasicClientWithConnection.java:33)
                at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:142)
                at org.apache.drill.exec.rpc.RpcBus$InboundHandler.decode(RpcBus.java:127)
                at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:89)
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
                at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
                at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:173)
                at io.netty.channel.DefaultChannelHandlerContext.invokeChannelRead(DefaultChannelHandlerContext.java:334)
                at io.netty.channel.DefaultChannelHandlerContext.fireChannelRead(DefaultChannelHandlerContext.java:320)
                at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:785)
                at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:100)
                at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:497)
                at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:465)
                at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:359)
                at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:101)
                at java.lang.Thread.run(Thread.java:724)

Regards

Adam Szulinski | Trainee Software Engineer | Kainos | DD: +48 766 7567 | a.szulinski@kainos.com<mailto:a.szulinski@kainos.com>



Follow the Kainos buzz on: [Twitter] <https://twitter.com/kainossoftware>  [Facebook]
<https://www.facebook.com/KainosSoftware>  [Linkedin] <http://www.linkedin.com/company/kainos>
 [Youtube] <http://www.youtube.com/user/KainosSoftware>

[Sunday Times]<http://www.kainos.com/news/kainos-catapulted-straight-in-at-55-in-the-sunday-times-best-companies-to-work-for-2013/>

This e-mail is intended solely for the addressee and is strictly confidential; if you are
not the addressee please destroy the message and all copies. Any opinion or information contained
in this email or its attachments that does not relate to the business of Kainos is personal
to the sender and is not given by or endorsed by Kainos. Kainos is the trading name of the
Kainos group of companies comprising the parent company, Kainos Software Limited, registered
in Northern Ireland under company number: NI19370, having its registered offices at: Kainos
House, 4-6 Upper Crescent, Belfast, BT7 1NT, Northern Ireland, registered in the UK for VAT
under number 454598802, and its wholly owned subsidiaries (i) Kainos Software Ireland Limited,
registered in Ireland with company number: 510943, having its registered office at 6-7 St
Stephen's Green, Dublin 2, Ireland, registered in Ireland for VAT under number: 9824105M and
(ii) Kainos Software Poland Spolka z.o.o, registered Poland with national business registry
number: 221656287, having its registered office at Centrum Biurowe Gnilna 2, ul. Gnilna 2,
IIIp, 80-847 Gdansk, Poland, registered in Poland with tax identification number 5833152587
(used for VAT purposes). This email has been scanned for all known viruses by MessageLabs
but is not guaranteed to be virus free; further terms and conditions may be found on our website
- www.kainos.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message