drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deneche A. Hakim (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1545) Json files can only be read when they have a .json extension
Date Tue, 18 Nov 2014 15:07:33 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216262#comment-14216262
] 

Deneche A. Hakim commented on DRILL-1545:
-----------------------------------------

The user can also write a separate config for json and log like this:
{code}
"json": {
  "type": "json",
  "extensions": [
    "json"
  ]
},
"log": {
  "type": "json",
  "extensions": [
    "log"
  ]
}
{code}

> Json files can only be read when they have a .json extension
> ------------------------------------------------------------
>
>                 Key: DRILL-1545
>                 URL: https://issues.apache.org/jira/browse/DRILL-1545
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Jason Altekruse
>            Assignee: Deneche A. Hakim
>             Fix For: 0.7.0
>
>         Attachments: DRILL-1545.1.patch.txt
>
>
> It seems that Drill can only discover json data if the file extension is .json.   
> We have tried to add the file extension.log as type json in the Storage Plugin (and validated
the json) , but without success. 
> Would be great if somebody can share a example config or has an idea.
> Storage Plugin Configuration.
> {
>   "type": "file",
>   "enabled": true,
>   "connection": "maprfs:///",
>   "workspaces": {
>     "root": {
>       "location": "/",
>       "writable": false,
>       "storageformat": null
>     },
>     "tmp": {
>       "location": "/tmp",
>       "writable": true,
>       "storageformat": "csv"
>     }
>   },
>   "formats": {
>     "log": {
>       "type": "json",
>       "extensions": [
>         "log"
>       ]
>     },
>     "psv": {
>       "type": "text",
>       "extensions": [
>         "tbl"
>       ],
>       "delimiter": "|"
>     },
>     "csv": {
>       "type": "text",
>       "extensions": [
>         "csv"
>       ],
>       "delimiter": ","
>     },
>     "tsv": {
>       "type": "text",
>       "extensions": [
>         "tsv"
>       ],
>       "delimiter": "\t"
>     },
>     "parquet": {
>       "type": "parquet"
>     },
>     "json": {
>       "type": "json"
> }
>   }
> }



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message