Mailing-List: contact issues-help@drill.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@drill.apache.org
Date: Wed, 5 Aug 2015 15:04:04 +0000 (UTC)
From: "james sun (JIRA)" <jira@apache.org>
To: issues@drill.apache.org
Message-ID: <JIRA.12851431.1438706474000.378377.1438787044803@Atlassian.JIRA>
In-Reply-To: <JIRA.12851431.1438706474000@Atlassian.JIRA>
References: <JIRA.12851431.1438706474000@Atlassian.JIRA>
 <JIRA.12851431.1438706474571@arcas>
Subject: [jira] [Commented] (DRILL-3602) Need to log filename when error
 happens
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/DRILL-3602?page=3Dcom.atlassian=
.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D1465=
8332#comment-14658332 ]=20

james sun commented on DRILL-3602:
----------------------------------

Hi Deneche,

For example, I have thousands of csv files and not all the fields in all cs=
v files are fully populated. some fields are empty. As I do a simple
select * command across all these files, error occurred when Drill hits the=
 file with empty fields. But the log doesn=E2=80=99t say which file is it p=
rocessing.
It would be easier for me to debug if it tells the file name so I can drill=
 down to the specific file without having to go through thousands of files.

Here is an example of a file with fully populated and empty fields:
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.14452,-118.08606,400,20091127,03:49:05
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.13642,-118.10855,400,20091127,03:49:17
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.13257,-118.13473,400,20091127,03:49:29
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.12983,-118.16765,400,20091127,03:49:41
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.12579,-118.19361,400,20091127,03:49:53
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737=
,38.11976,-118.2209,400,20091127,03:50:05
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57353,=
-121.58741,21,20091127,00:10:04
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57512,=
-121.58511,21,20091127,00:10:09
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57671,=
-121.58281,21,20091127,00:10:13
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57889,=
-121.5792,22,20091127,00:10:18
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.4816=
7,-121.65603,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.4805=
5,-121.65398,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.4802=
8,-121.64923,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.4795=
5,-121.64573,30,

-James


> Need to log filename when error happens
> ---------------------------------------
>
>                 Key: DRILL-3602
>                 URL: https://issues.apache.org/jira/browse/DRILL-3602
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Functions - Drill
>    Affects Versions: 1.1.0
>            Reporter: james sun
>            Assignee: Mehant Baid
>
> Error in the log but there is not enough information as to which file dri=
ll was processing when the errors happened, e.g.
> 2015-08-04 01:51:15,885 [Client-1] INFO  o.a.d.j.i.DrillResultSetImpl$Res=
ultsListener - [#1] Query failed:
> org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: Ill=
egalArgumentException: Invalid format: ""
> It will be helpful for trouble shooting purpose to log the file name.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)