drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bob Rumsby <brum...@maprtech.com>
Subject Re: [jira] [Created] (DRILL-1718) FLATTEN query returns "buffer is neither a method, a field, nor a member class..." error
Date Sat, 15 Nov 2014 06:54:06 GMT
Thanks, I will try it. I realize my mistake now, but the Drill error
messages need to be written in such a way that they help users identify
where the real problem is.

Bob

On Fri, Nov 14, 2014 at 8:49 PM, Neeraja Rentachintala <
nrentachintala@maprtech.com> wrote:

> Bob
> Categories in yelp dataset is a array.
> So your query should look like below
>
> select name, flatten(categories) as categories from
> dfs.yelp.`yelp_academic_dataset_business.json`
> where repeated_contains(categories,'Pizza') = true
>
> Can you try this out.
>
> On Fri, Nov 14, 2014 at 6:27 PM, Bob Rumsby (JIRA) <jira@apache.org>
> wrote:
>
> > Bob Rumsby created DRILL-1718:
> > ---------------------------------
> >
> >              Summary: FLATTEN query returns "buffer is neither a method,
> a
> > field, nor a member class..." error
> >                  Key: DRILL-1718
> >                  URL: https://issues.apache.org/jira/browse/DRILL-1718
> >              Project: Apache Drill
> >           Issue Type: Bug
> >           Components: Functions - Drill
> >     Affects Versions: 0.7.0
> >          Environment: 0.7.0 snapshot on MacOSX in embedded mode
> >             Reporter: Bob Rumsby
> >
> >
> > A query with a FLATTEN function and a WHERE clause constraint on the
> > flattened column fails.
> >
> > 0: jdbc:drill:zk=local> select name, flatten(categories) as categories
> > from dfs.yelp.`yelp_academic_dataset_business.json` where
> > categories='Pizza';
> > Query failed: Failure while running fragment., Line 68, Column 95:
> > "buffer" is neither a method, a field, nor a member class of
> > "org.apache.drill.exec.expr.holders.RepeatedVarCharHolder" [
> > 67016271-7266-4438-9529-d8330b1e39a4 on 10.250.0.28:31010 ]
> >
> >
> > Error: exception while executing query: Failure while executing query.
> > (state=,code=0)
> > 0: jdbc:drill:zk=local> explain plan for select name, flatten(categories)
> > as categories from dfs.yelp.`yelp_academic_dataset_business.json` where
> > categories='Pizza';
> > +------------+------------+
> > |    text    |    json    |
> > +------------+------------+
> > | 00-00    Screen
> > 00-01      Project(name=[$1], categories=[$2])
> > 00-02        Flatten(flattenField=[$2])
> > 00-03          Project(EXPR$0=[$0], EXPR$1=[$1], EXPR$2=[$0])
> > 00-04            SelectionVectorRemover
> > 00-05              Filter(condition=[=($0, 'Pizza')])
> > 00-06                Scan(groupscan=[EasyGroupScan
> >
> [selectionRoot=/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json,
> > numFiles=1, columns=[`categories`, `name`],
> >
> files=[file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json]]])
> >  | {
> >   "head" : {
> >     "version" : 1,
> >     "generator" : {
> >       "type" : "ExplainHandler",
> >       "info" : ""
> >     },
> >     "type" : "APACHE_DRILL_PHYSICAL",
> >     "options" : [ ],
> >     "queue" : 0,
> >     "resultMode" : "EXEC"
> >   },
> >   "graph" : [ {
> >     "pop" : "fs-scan",
> >     "@id" : 6,
> >     "files" : [
> >
> "file:/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json"
> > ],
> >     "storage" : {
> >       "type" : "file",
> >       "enabled" : true,
> >       "connection" : "file:///",
> >       "workspaces" : {
> >         "root" : {
> >           "location" : "/",
> >           "writable" : false,
> >           "defaultInputFormat" : null
> >         },
> >         "yelp" : {
> >           "location" :
> > "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata",
> >           "writable" : true,
> >           "defaultInputFormat" : null
> >         }
> >       },
> >       "formats" : {
> >         "psv" : {
> >           "type" : "text",
> >           "extensions" : [ "tbl" ],
> >           "delimiter" : "|"
> >         },
> >         "csv" : {
> >           "type" : "text",
> >           "extensions" : [ "csv" ],
> >           "delimiter" : ","
> >         },
> >         "tsv" : {
> >           "type" : "text",
> >           "extensions" : [ "tsv" ],
> >           "delimiter" : "\t"
> >         },
> >         "parquet" : {
> >           "type" : "parquet"
> >         },
> >         "json" : {
> >           "type" : "json"
> >         }
> >       }
> >     },
> >     "format" : {
> >       "type" : "json"
> >     },
> >     "columns" : [ "`categories`", "`name`" ],
> >     "selectionRoot" :
> >
> "/Users/brumsby/drill/apache-drill-0.7.0-incubating-SNAPSHOT/yelpdata/yelp_academic_dataset_business.json",
> >     "cost" : 36382.0
> >   }, {
> >     "pop" : "filter",
> >     "@id" : 5,
> >     "child" : 6,
> >     "expr" : "equal(`categories`, 'Pizza') ",
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   }, {
> >     "pop" : "selection-vector-remover",
> >     "@id" : 4,
> >     "child" : 5,
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   }, {
> >     "pop" : "project",
> >     "@id" : 3,
> >     "exprs" : [ {
> >       "ref" : "`EXPR$0`",
> >       "expr" : "`categories`"
> >     }, {
> >       "ref" : "`EXPR$1`",
> >       "expr" : "`name`"
> >     }, {
> >       "ref" : "`EXPR$2`",
> >       "expr" : "`categories`"
> >     } ],
> >     "child" : 4,
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   }, {
> >     "pop" : "flatten",
> >     "@id" : 2,
> >     "child" : 3,
> >     "column" : "`EXPR$2`",
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   }, {
> >     "pop" : "project",
> >     "@id" : 1,
> >     "exprs" : [ {
> >       "ref" : "`name`",
> >       "expr" : "`EXPR$1`"
> >     }, {
> >       "ref" : "`categories`",
> >       "expr" : "`EXPR$2`"
> >     } ],
> >     "child" : 2,
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   }, {
> >     "pop" : "screen",
> >     "@id" : 0,
> >     "child" : 1,
> >     "initialAllocation" : 1000000,
> >     "maxAllocation" : 10000000000,
> >     "cost" : 5457.3
> >   } ]
> > } |
> > +------------+------------+
> > 1 row selected (0.115 seconds)
> > 0: jdbc:drill:zk=local>
> >
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v6.3.4#6332)
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message