flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suneel Marthi <smar...@apache.org>
Subject Re: Flink Table & SQL doesn't work in very simple example
Date Wed, 20 Jul 2016 11:43:30 GMT
I am not seeing an issue with this code Radu, this is from present
1.1-Snapshot.

This is what I have and it works (running from within IntelliJ and not cli)
:


List<Tuple3<Long, String, Integer>> input = new ArrayList<>();
input.add(new Tuple3<>(3L,"test",1));
input.add(new Tuple3<>(5L,"test2",2));
StreamExecutionEnvironment env =
StreamExecutionEnvironment.createLocalEnvironment(1);
DataStream<Tuple3<Long, String, Integer>> ds = env.fromCollection(input);

StreamTableEnvironment tableEnv = TableEnvironment.getTableEnvironment(env);

tableEnv.registerDataStream("Words", ds, "frequency, word, pos");
// run a SQL query on the Table and retrieve the result as a new Table
Table result = tableEnv.sql("SELECT STREAM word, pos FROM Words WHERE
frequency > 2");




On Wed, Jul 20, 2016 at 6:55 AM, Radu Tudoran <radu.tudoran@huawei.com>
wrote:

> Hi,
>
> As far as I managed to isolate the cause of the error so far it has to do
> with some mismatch in the function call
>
> val traitDefs:ImmutableList[RelTraitDef[_ <: RelTrait]] =
> config.getTraitDefs
>
> I am not sure thought why it is not working because when I tried to make a
> dummy test by creating a program and  calling that function, everything
> works.
> Can it be that there is some overlapping between libraries that contain
> the ImmutableList type?
> google/common/collect/ImmutableList (with flink shaded)?
> As per the error
> "/apache/flink/shaded/calcite/com/google/common/collect/ImmutableList;"
>
>
> -----Original Message-----
> From: Maximilian Michels [mailto:mxm@apache.org]
> Sent: Wednesday, July 20, 2016 11:52 AM
> To: dev@flink.apache.org
> Cc: Timo Walther
> Subject: Re: Flink Table & SQL doesn't work in very simple example
>
> CC Timo who I know is working on Table API and SQL.
>
>
>
> On Tue, Jul 19, 2016 at 6:14 PM, Radu Tudoran <radu.tudoran@huawei.com>
> wrote:
> > Hi,
> >
> > I am not sure that this problem was solved. I am using the last pom to
> compile the table API.
> >
> > I was trying to run a simple program.
> >
> >
> > ArrayList<Tuple3<Long, String, Integer>> input = new
> ArrayList<Tuple3<Long, String, Integer>>();
> >                 input.add(new Tuple3<Long, String,
> Integer>(3L,"test",1));
> >                 input.add(new Tuple3<Long, String,
> > Integer>(5L,"test2",2));
> >
> >                 DataStream<Tuple3<Long, String, Integer>> ds =
> > env.fromCollection(input);
> >
> > StreamTableEnvironment tableEnv =
> > TableEnvironment.getTableEnvironment(env);
> >
> >                 tableEnv.registerDataStream("Words", ds, "frequency,
> word, position");
> >                 // run a SQL query on the Table and retrieve the result
> as a new Table
> >                 Table result = tableEnv.sql(
> >                   "SELECT STREAM product, amount FROM Words WHERE
> > frequency > 2");
> >
> >
> >
> > ..and I get:
> >
> > Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.calcite.tools.FrameworkConfig.getTraitDefs()Lorg/apache/flink/shaded/calcite/com/google/common/collect/ImmutableList;
> >         at
> org.apache.flink.api.table.FlinkPlannerImpl.<init>(FlinkPlannerImpl.scala:50)
> >         at
> org.apache.flink.api.table.StreamTableEnvironment.sql(StreamTableEnvironment.scala:127)
> >         at TestStreamSQL.main(TestStreamSQL.java:69)
> >
> >
> > Any thoughts on how this can be solved?
> >
> >
> > Dr. Radu Tudoran
> > Research Engineer - Big Data Expert
> > IT R&D Division
> >
> >
> > HUAWEI TECHNOLOGIES Duesseldorf GmbH
> > European Research Center
> > Riesstrasse 25, 80992 München
> >
> > E-mail: radu.tudoran@huawei.com
> > Mobile: +49 15209084330
> > Telephone: +49 891588344173
> >
> > HUAWEI TECHNOLOGIES Duesseldorf GmbH
> > Hansaallee 205, 40549 Düsseldorf, Germany, www.huawei.com Registered
> > Office: Düsseldorf, Register Court Düsseldorf, HRB 56063, Managing
> > Director: Bo PENG, Wanzhou MENG, Lifang CHEN Sitz der Gesellschaft:
> > Düsseldorf, Amtsgericht Düsseldorf, HRB 56063,
> > Geschäftsführer: Bo PENG, Wanzhou MENG, Lifang CHEN This e-mail and
> > its attachments contain confidential information from HUAWEI, which is
> intended only for the person or entity whose address is listed above. Any
> use of the information contained herein in any way (including, but not
> limited to, total or partial disclosure, reproduction, or dissemination) by
> persons other than the intended recipient(s) is prohibited. If you receive
> this e-mail in error, please notify the sender by phone or email
> immediately and delete it!
> >
> >
> > -----Original Message-----
> > From: Fabian Hueske [mailto:fhueske@gmail.com]
> > Sent: Thursday, June 23, 2016 11:13 AM
> > To: dev@flink.apache.org
> > Subject: Re: Flink Table & SQL doesn't work in very simple example
> >
> > Hi Jark Wu,
> >
> > yes, that looks like a dependency issue.
> > Can you open a JIRA for it set "Fix Version" to 1.1.0. This issue should
> be resolved for the 1.1 release.
> >
> > Thanks, Fabian
> >
> > 2016-06-22 3:52 GMT+02:00 Jark Wu <wuchong.wc@alibaba-inc.com>:
> >
> >> Hi,
> >>
> >>
> >> I’m trying to use Flink Table 1.1-SNAPSHOT where I want to use Table
> >> API and SQL in my project. But when I run the very simple example
> >> WordCountTable, I encountered the following exception :
> >>
> >> Exception in thread "main" java.lang.NoSuchMethodError:
> >>
> org.apache.calcite.rel.logical.LogicalAggregate.getGroupSets()Lorg/apache/flink/shaded/com/google/common/collect/ImmutableList;
> >>   at
> >>
> org.apache.flink.api.table.plan.rules.dataSet.DataSetAggregateRule.matches(DataSetAggregateRule.scala:47)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoRuleCall.matchRecurse(VolcanoRuleCall.java:269)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoRuleCall.match(VolcanoRuleCall.java:253)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoPlanner.fireRules(VolcanoPlanner.java:1542)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoPlanner.registerImpl(VolcanoPlanner.java:1817)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoPlanner.register(VolcanoPlanner.java:1038)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoPlanner.ensureRegistered(VolcanoPlanner.java:1058)
> >>   at
> >>
> org.apache.calcite.plan.volcano.VolcanoPlanner.changeTraits(VolcanoPlanner.java:723)
> >>   at
> >> org.apache.calcite.tools.Programs$RuleSetProgram.run(Programs.java:331)
> >>   at
> >>
> org.apache.flink.api.table.BatchTableEnvironment.translate(BatchTableEnvironment.scala:250)
> >>   at
> >>
> org.apache.flink.api.scala.table.BatchTableEnvironment.toDataSet(BatchTableEnvironment.scala:139)
> >>   at
> >>
> org.apache.flink.api.scala.table.TableConversions.toDataSet(TableConversions.scala:41)
> >>   at
> >> com.alibaba.flink.examples.WordCountTable$.main(WordCountTable.scala:43)
> >>   at
> >> com.alibaba.flink.examples.WordCountTable.main(WordCountTable.scala)
> >>
> >>
> >> It seems that something  wrong with our guava shade. Do you have any
> ideas?
> >>
> >> My pom file and WordCountTable.scala are here:
> >> https://gist.github.com/wuchong/9c1c0df3cb7453502abc4605f5347289 <
> >> https://gist.github.com/wuchong/9c1c0df3cb7453502abc4605f5347289>
> >>
> >> And I found someone have the same problem on stack overflow:
> >> http://stackoverflow.com/questions/37835408/org-apache-flink-api-tabl
> >> e
> >> -tableexception-alias-on-field-reference-expression-e#comment63160086
> >> _
> >> 37838816
> >> <
> >> http://stackoverflow.com/questions/37835408/org-apache-flink-api-tabl
> >> e
> >> -tableexception-alias-on-field-reference-expression-e#comment63160086
> >> _
> >> 37838816
> >> >
> >> - Jark Wu
> >>
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message