drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-4653) Malformed JSON should not stop the entire query from progressing
Date Thu, 14 Jul 2016 19:56:20 GMT

    [ https://issues.apache.org/jira/browse/DRILL-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378249#comment-15378249
] 

ASF GitHub Bot commented on DRILL-4653:
---------------------------------------

Github user chunhui-shi commented on a diff in the pull request:

    https://github.com/apache/drill/pull/518#discussion_r70872218
  
    --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/store/json/TestJsonRecordReader.java
---
    @@ -56,11 +57,19 @@ public void trySimpleQueryWithLimit() throws Exception {
         test("select * from cp.`limit/test1.json` limit 10");
       }
     
    -  @Test// DRILL-1634 : retrieve an element in a nested array in a repeated map.  RepeatedMap
(Repeated List (Repeated varchar))
    +  @Test
    +  // DRILL-1634 : retrieve an element in a nested array in a repeated map.
    +  // RepeatedMap (Repeated List (Repeated varchar))
       public void testNestedArrayInRepeatedMap() throws Exception {
         test("select a[0].b[0] from cp.`jsoninput/nestedArray.json`");
         test("select a[0].b[1] from cp.`jsoninput/nestedArray.json`");
    -    test("select a[1].b[1] from cp.`jsoninput/nestedArray.json`");  // index out of the
range. Should return empty list.
    +    test("select a[1].b[1] from cp.`jsoninput/nestedArray.json`"); // index out
    --- End diff --
    
    comment format


> Malformed JSON should not stop the entire query from progressing
> ----------------------------------------------------------------
>
>                 Key: DRILL-4653
>                 URL: https://issues.apache.org/jira/browse/DRILL-4653
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - JSON
>    Affects Versions: 1.6.0
>            Reporter: subbu srinivasan
>             Fix For: Future
>
>
> Currently Drill query terminates upon first encounter of a invalid JSON line.
> Drill has to continue progressing after ignoring the bad records. Something 
> similar to a setting of (ignore.malformed.json) would help.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message