Return-Path: X-Original-To: apmail-incubator-drill-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-drill-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D6FD71014D for ; Wed, 19 Nov 2014 16:03:05 +0000 (UTC) Received: (qmail 27484 invoked by uid 500); 19 Nov 2014 16:03:05 -0000 Delivered-To: apmail-incubator-drill-user-archive@incubator.apache.org Received: (qmail 27378 invoked by uid 500); 19 Nov 2014 16:03:05 -0000 Mailing-List: contact drill-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: drill-user@incubator.apache.org Delivered-To: mailing list drill-user@incubator.apache.org Received: (qmail 27354 invoked by uid 99); 19 Nov 2014 16:03:04 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Nov 2014 16:03:04 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of lapro1@gmail.com designates 209.85.215.41 as permitted sender) Received: from [209.85.215.41] (HELO mail-la0-f41.google.com) (209.85.215.41) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Nov 2014 16:02:38 +0000 Received: by mail-la0-f41.google.com with SMTP id gf13so771270lab.28 for ; Wed, 19 Nov 2014 08:02:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=XhBV+qr6nnb/08naWHqmHVgdUlko8jIO2zvGPLCgcZE=; b=OuQSC48UOQb+92YfB6YpwV2xSCSqFCS/k8C4wTa0ijW7s9MOiDylD3oeGbfxrazMTo evSg9YaJfp4Cc07Fhvwe7ydFJKWa5ht0CPowRzk6aT4uz2ZWVj93m33dxWbjnvX3GTAr nWzCIgt1ntzog99lWkVcxwt6M9OXtUjRLfHJ9J3slSjtfxPQRoQyY24ocAEPaqX+2fZv uzTA4sgoh6eh0Q/sLJoykFfDBG3TNpEt74Kz8F/NHQPXfmTWqUCbIDKPlYirjzbqQAnL T1JtWgcsPJfcJQmJbW4pZNHdW6syJiUfMuX+grDpVemVgSSkw2B0dKa4u+jWZ+VEAItt DENw== MIME-Version: 1.0 X-Received: by 10.112.144.228 with SMTP id sp4mr6009408lbb.58.1416412957617; Wed, 19 Nov 2014 08:02:37 -0800 (PST) Received: by 10.114.70.111 with HTTP; Wed, 19 Nov 2014 08:02:37 -0800 (PST) In-Reply-To: References: Date: Wed, 19 Nov 2014 17:02:37 +0100 Message-ID: Subject: Re: Drill stops immediately From: lapro1 To: drill-dev@incubator.apache.org, drill-user@incubator.apache.org, =?UTF-8?B?S2F6aSBTw6FuZG9y?= Content-Type: multipart/alternative; boundary=047d7b3a8f5a31b2560508385753 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b3a8f5a31b2560508385753 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi, I gave the table create command to it again, which was written in my prior letter. It stopped again. Here is the last 50 lines of drillbit.log, please help me to find the problem :) [root@sandbox log]# tail -n 50 drillbit.log 2014-11-19 07:52:07,538 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 852683 2014-11-19 07:52:07,543 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200047 2014-11-19 07:52:07,552 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 854048 2014-11-19 07:52:07,557 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 854680 2014-11-19 07:52:07,562 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200082 2014-11-19 07:52:07,572 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 856045 2014-11-19 07:52:07,577 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 856680 2014-11-19 07:52:07,583 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200000 2014-11-19 07:52:07,593 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 858045 2014-11-19 07:52:07,598 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 858666 2014-11-19 07:52:07,605 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200076 2014-11-19 07:52:07,614 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 860031 2014-11-19 07:52:07,621 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 860622 2014-11-19 07:52:07,626 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200085 2014-11-19 07:52:07,637 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 861987 2014-11-19 07:52:07,643 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 862588 2014-11-19 07:52:07,649 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.s.text.DrillTextRecordReader - text scan batch size 200041 2014-11-19 07:52:07,657 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 863953 2014-11-19 07:52:07,662 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:1:0] DEBUG o.a.d.e.p.impl.WriterRecordBatch - Total records written so far: 864570 2014-11-19 07:52:08,411 [5a518e58-a6d4-4d0e-a3b7-85172c737e1a:frag:0:0] DEBUG o.a.d.e.compile.JaninoClassCompiler - Compiling (source size=3D617 B)= : 1: 2: package org.apache.drill.exec.test.generated; 3: 4: import org.apache.drill.exec.exception.SchemaChangeException; 5: import org.apache.drill.exec.ops.FragmentContext; 6: import org.apache.drill.exec.record.RecordBatch; 7: 8: public class ProjectorGen2 { 9: 10: 11: public boolean doEval(int inIndex, int outIndex) 12: throws SchemaChangeException 13: { 14: { 15: return true; 16: } 17: } 18: 19: public void doSetup(FragmentContext context, RecordBatch incoming, RecordBatch outgoing) 20: throws SchemaChangeException 21: { 22: } 23: 24: public void __DRILL_INIT__() 25: throws SchemaChangeException 26: { 27: } 28: 29: } Thanks in advance, Laszlo 2014-11-18 20:44 GMT+01:00 Timothy Chen : > What does the log says when the drillbit stops? > > Tim > > On Tue, Nov 18, 2014 at 9:11 AM, lapro1 wrote: > > Hi, > > My drill does the following problem, and it's quite disturbing, because > it > > stops my job, and I have to wait for it for really long time. > > Sometimes, if I create a table, or I'd like to query something, it stop= s > > without any answer. I have to restart drillbit, but also this is very > slow. > > For example it takes about 15-20 minutes for. > > > > [root@sandbox ~]# /opt/drill/bin/drillbit.sh stop > > Drill log directory /var/log/drill does not exist, defaulting to > > /opt/drill/log > > stopping drillbit > > > .........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ...........................................................................= ....................................................................force > > stopping drillbit with kill -9 10790 > > [root@sandbox ~]# > > > > > > I use drill over hadoop with only one datanode, because I'm a test user= , > > and my computer would be very slowly with more virtual machines. Is it > > possible, that this couses the problem? > > > > Last, when it stopped I gave it the command below: > > 0: jdbc:drill:zk=3Dmaster:2181> create table nasadata(host, datetime, > > request, response1, response2) as select columns[0] AS `host`, columns[= 1] > > AS `datetime`, columns[2] AS `request`, columns[3] AS `response1`, > > columns[4] AS `response2` from dfs.`/drill/datafiles/log_Aug.csv`; > > > > Thanks the answer in advance. > > Laszlo > --047d7b3a8f5a31b2560508385753--