drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "james sun (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-3602) Need to log filename when error happens
Date Wed, 05 Aug 2015 15:04:04 GMT

    [ https://issues.apache.org/jira/browse/DRILL-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658332#comment-14658332
] 

james sun commented on DRILL-3602:
----------------------------------

Hi Deneche,

For example, I have thousands of csv files and not all the fields in all csv files are fully
populated. some fields are empty. As I do a simple
select * command across all these files, error occurred when Drill hits the file with empty
fields. But the log doesn’t say which file is it processing.
It would be easier for me to debug if it tells the file name so I can drill down to the specific
file without having to go through thousands of files.

Here is an example of a file with fully populated and empty fields:
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.14452,-118.08606,400,20091127,03:49:05
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.13642,-118.10855,400,20091127,03:49:17
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.13257,-118.13473,400,20091127,03:49:29
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.12983,-118.16765,400,20091127,03:49:41
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.12579,-118.19361,400,20091127,03:49:53
SWA2546,2009112785748073,20091127034905NCT6243SWA2546,NCT,6243,MDW,SFO,B737,38.11976,-118.2209,400,20091127,03:50:05
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57353,-121.58741,21,20091127,00:10:04
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57512,-121.58511,21,20091127,00:10:09
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57671,-121.58281,21,20091127,00:10:13
CHP21,2009112785747581,20091127000756NCT0327CHP21,NCT,0327,,,C206,38.57889,-121.5792,22,20091127,00:10:18
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48167,-121.65603,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48055,-121.65398,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.48028,-121.64923,30,
N6042N,2009112785788577,20091127223624NCT4635N6042N,NCT,4635,,,C172,38.47955,-121.64573,30,

-James




> Need to log filename when error happens
> ---------------------------------------
>
>                 Key: DRILL-3602
>                 URL: https://issues.apache.org/jira/browse/DRILL-3602
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Functions - Drill
>    Affects Versions: 1.1.0
>            Reporter: james sun
>            Assignee: Mehant Baid
>
> Error in the log but there is not enough information as to which file drill was processing
when the errors happened, e.g.
> 2015-08-04 01:51:15,885 [Client-1] INFO  o.a.d.j.i.DrillResultSetImpl$ResultsListener
- [#1] Query failed:
> org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalArgumentException:
Invalid format: ""
> It will be helpful for trouble shooting purpose to log the file name.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message