drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Neeraja Rentachintala <nrentachint...@maprtech.com>
Subject Re: [jira] [Created] (DRILL-1718) FLATTEN query returns "buffer is neither a method, a field, nor a member class..." error
Date Sat, 15 Nov 2014 04:49:25 GMT
Bob
Categories in yelp dataset is a array.
So your query should look like below

select name, flatten(categories) as categories from
dfs.yelp.`yelp_academic_dataset_business.json`
where repeated_contains(categories,'Pizza') = true

Can you try this out.

On Fri, Nov 14, 2014 at 6:27 PM, Bob Rumsby (JIRA) <jira@apache.org> wrote:

> Bob Rumsby created DRILL-1718:
> ---------------------------------
>
>              Summary: FLATTEN query returns "buffer is neither a method, a
> field, nor a member class..." error
>                  Key: DRILL-1718
>                  URL: https://issues.apache.org/jira/browse/DRILL-1718
>              Project: Apache Drill
>           Issue Type: Bug
>           Components: Functions - Drill
>     Affects Versions: 0.7.0
>          Environment: 0.7.0 snapshot on MacOSX in embedded mode
>             Reporter: Bob Rumsby
>
>
> A query with a FLATTEN function and a WHERE clause constraint on the
> flattened column fails.
>
> 0: jdbc:drill:zk=local> select name, flatten(categories) as categories
> from dfs.yelp.`yelp_academic_dataset_business.json` where
> categories='Pizza';
> Query failed: Failure while running fragment., Line 68, Column 95:
> "buffer" is neither a method, a field, nor a member class of
> "org.apache.drill.exec.expr.holders.RepeatedVarCharHolder" [
> 67016271-7266-4438-9529-d8330b1e39a4 on 10.250.0.28:31010 ]
>
>
> Error: exception while executing query: Failure while executing query.
> (state=,code=0)
> 0: jdbc:drill:zk=local> explain plan for select name, flatten(categories)
> as categories from dfs.yelp.`yelp_academic_dataset_business.json` where
> categories='Pizza';
> +------------+------------+
> |    text    |    json    |
> +------------+------------+
> | 00-00    Screen
> 00-01      Project(name=[$1], categories=[$2])
> 00-02        Flatten(flattenField=[$2])
> 00-03          Project(EXPR$0=[$0], EXPR$1=[$1], EXPR$2=[$0])
> 00-04            SelectionVectorRemover
> 00-05              Filter(condition=[=($0, 'Pizza')])
> 00-06                Scan(groupscan=[EasyGroupScan
> [selectionRoot=/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json,
> numFiles=1, columns=[`categories`, `name`],
> files=[file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json]]])
>  | {
>   "head" : {
>     "version" : 1,
>     "generator" : {
>       "type" : "ExplainHandler",
>       "info" : ""
>     },
>     "type" : "APACHE_DRILL_PHYSICAL",
>     "options" : [ ],
>     "queue" : 0,
>     "resultMode" : "EXEC"
>   },
>   "graph" : [ {
>     "pop" : "fs-scan",
>     "@id" : 6,
>     "files" : [
> "file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json"
> ],
>     "storage" : {
>       "type" : "file",
>       "enabled" : true,
>       "connection" : "file:///",
>       "workspaces" : {
>         "root" : {
>           "location" : "/",
>           "writable" : false,
>           "defaultInputFormat" : null
>         },
>         "yelp" : {
>           "location" :
> "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata",
>           "writable" : true,
>           "defaultInputFormat" : null
>         }
>       },
>       "formats" : {
>         "psv" : {
>           "type" : "text",
>           "extensions" : [ "tbl" ],
>           "delimiter" : "|"
>         },
>         "csv" : {
>           "type" : "text",
>           "extensions" : [ "csv" ],
>           "delimiter" : ","
>         },
>         "tsv" : {
>           "type" : "text",
>           "extensions" : [ "tsv" ],
>           "delimiter" : "\t"
>         },
>         "parquet" : {
>           "type" : "parquet"
>         },
>         "json" : {
>           "type" : "json"
>         }
>       }
>     },
>     "format" : {
>       "type" : "json"
>     },
>     "columns" : [ "`categories`", "`name`" ],
>     "selectionRoot" :
> "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json",
>     "cost" : 36382.0
>   }, {
>     "pop" : "filter",
>     "@id" : 5,
>     "child" : 6,
>     "expr" : "equal(`categories`, 'Pizza') ",
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   }, {
>     "pop" : "selection-vector-remover",
>     "@id" : 4,
>     "child" : 5,
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   }, {
>     "pop" : "project",
>     "@id" : 3,
>     "exprs" : [ {
>       "ref" : "`EXPR$0`",
>       "expr" : "`categories`"
>     }, {
>       "ref" : "`EXPR$1`",
>       "expr" : "`name`"
>     }, {
>       "ref" : "`EXPR$2`",
>       "expr" : "`categories`"
>     } ],
>     "child" : 4,
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   }, {
>     "pop" : "flatten",
>     "@id" : 2,
>     "child" : 3,
>     "column" : "`EXPR$2`",
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   }, {
>     "pop" : "project",
>     "@id" : 1,
>     "exprs" : [ {
>       "ref" : "`name`",
>       "expr" : "`EXPR$1`"
>     }, {
>       "ref" : "`categories`",
>       "expr" : "`EXPR$2`"
>     } ],
>     "child" : 2,
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   }, {
>     "pop" : "screen",
>     "@id" : 0,
>     "child" : 1,
>     "initialAllocation" : 1000000,
>     "maxAllocation" : 10000000000,
>     "cost" : 5457.3
>   } ]
> } |
> +------------+------------+
> 1 row selected (0.115 seconds)
> 0: jdbc:drill:zk=local>
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message