flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Craig Foster <foster.cr...@gmail.com>
Subject Scala Shell gives error "rest.address must be set"
Date Tue, 17 Mar 2020 21:23:14 GMT
Hi:
When I upgraded from Flink 1.9.1 to Flink 1.10.0 I can't execute
programs at the Scala shell.

It gives me an error that the REST address must be set. This looks
like it comes from HA but I don't have HA configured for Flink and it
was very hard to find this documented other than in the PR/JIRA in the
history so don't have much context. Can someone point me to how to
configure this properly? For reference, I put the example stacktrace
below.

scala> val text = benv.fromElements("To be, or not to be,--that is the
question:--");
text: org.apache.flink.api.scala.DataSet[String] =
org.apache.flink.api.scala.DataSet@2396408a

scala> val counts = text.flatMap { _.toLowerCase.split("\\W+")}.map {
(_, 1) }.groupBy(0).sum(1);
counts: org.apache.flink.api.scala.AggregateDataSet[(String, Int)] =
org.apache.flink.api.scala.AggregateDataSet@38bce2ed

scala> counts.print()
20/03/17 21:15:34 INFO java.ExecutionEnvironment: The job has 0
registered types and 0 default Kryo serializers
20/03/17 21:15:34 INFO configuration.GlobalConfiguration: Loading
configuration property: env.yarn.conf.dir, /etc/hadoop/conf
20/03/17 21:15:34 INFO configuration.GlobalConfiguration: Loading
configuration property: env.hadoop.conf.dir, /etc/hadoop/conf
java.lang.RuntimeException: Couldn't retrieve standalone cluster
  at org.apache.flink.client.deployment.StandaloneClusterDescriptor.lambda$retrieve$0(StandaloneClusterDescriptor.java:53)
  at org.apache.flink.client.deployment.executors.AbstractSessionClusterExecutor.execute(AbstractSessionClusterExecutor.java:64)
  at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:944)
  at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:860)
  at org.apache.flink.api.java.ScalaShellEnvironment.execute(ScalaShellEnvironment.java:81)
  at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:844)
  at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
  at org.apache.flink.api.java.DataSet.print(DataSet.java:1652)
  at org.apache.flink.api.scala.DataSet.print(DataSet.scala:1864)
  ... 30 elided
Caused by: java.lang.NullPointerException: rest.address must be set
  at org.apache.flink.util.Preconditions.checkNotNull(Preconditions.java:104)
  at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.getWebMonitorAddress(HighAvailabilityServicesUtils.java:196)
  at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createClientHAService(HighAvailabilityServicesUtils.java:146)
  at org.apache.flink.client.program.rest.RestClusterClient.<init>(RestClusterClient.java:161)
  at org.apache.flink.client.deployment.StandaloneClusterDescriptor.lambda$retrieve$0(StandaloneClusterDescriptor.java:51)
  ... 38 more

Mime
View raw message