drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lapro1 <lap...@gmail.com>
Subject Re: Drill stops immediately
Date Wed, 19 Nov 2014 16:02:37 GMT
Hi,
I gave the table create command to it again, which was written in my prior
letter.
It stopped again.
Here is the last 50 lines of drillbit.log, please help me to find the
problem :)

[root@sandbox log]# tail -n 50 drillbit.log
2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
852683
2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047
2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854048
2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
854680
2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082
2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856045
2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
856680
2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000
2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858045
2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
858666
2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076
2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860031
2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
860622
2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085
2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
861987
2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
862588
2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041
2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
863953
2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0]
DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far:
864570
2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0]
DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=617 B):
1:
2:      package org.apache.drill.exec.test.generated;
3:
4:      import org.apache.drill.exec.exception.SchemaChangeException;
5:      import org.apache.drill.exec.ops.FragmentContext;
6:      import org.apache.drill.exec.record.RecordBatch;
7:
8:      public class ProjectorGen2 {
9:
10:
11:         public boolean doEval(int inIndex, int outIndex)
12:             throws SchemaChangeException
13:         {
14:             {
15:                 return true;
16:             }
17:         }
18:
19:         public void doSetup(FragmentContext context, RecordBatch
incoming, RecordBatch outgoing)
20:             throws SchemaChangeException
21:         {
22:         }
23:
24:         public void __DRILL_INIT__()
25:             throws SchemaChangeException
26:         {
27:         }
28:
29:     }


Thanks in advance,
Laszlo



2014-11-18 20:44 GMT+01:00 Timothy Chen <tnachen@gmail.com>:

> What does the log says when the drillbit stops?
>
> Tim
>
> On Tue, Nov 18, 2014 at 9:11 AM, lapro1 <lapro1@gmail.com> wrote:
> > Hi,
> > My drill does the following problem, and it's quite disturbing, because
> it
> > stops my job, and I have to wait for it for really long time.
> > Sometimes, if I create a table, or I'd like to query something, it stops
> > without any answer. I have to restart drillbit, but also this is very
> slow.
> > For example it takes about 15-20 minutes for.
> >
> > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop
> > Drill log directory /var/log/drill does not exist, defaulting to
> > /opt/drill/log
> > stopping drillbit
> >
> .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................force
> > stopping drillbit with kill -9 10790
> > [root@sandbox ~]#
> >
> >
> > I use drill over hadoop with only one datanode, because I'm a test user,
> > and my computer would be very slowly with more virtual machines. Is it
> > possible, that this couses the problem?
> >
> > Last, when it stopped I gave it the command below:
> > 0: jdbc:drill:zk=master:2181> create table nasadata(host, datetime,
> > request, response1, response2) as select columns[0] AS `host`, columns[1]
> > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`,
> > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`;
> >
> > Thanks the answer in advance.
> > Laszlo
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message