flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Re: Cannot run Storm WordCountLocal
Date Wed, 07 Oct 2015 23:24:50 GMT
The mini cluster is started with not enough slots. I would guess that it is
luck that the IT case works because the test environment probably uses a
simple default of 4 slots or so for the mini cluster.

The LocalEnvironment in the DataSet API actually makes a pass over the
operators to see how many operators are executed and how they share the
slots, to compute how many slots are needed when the mini cluster is
started. I assume you need something similar here.

On Thu, Oct 8, 2015 at 1:18 AM, Matthias J. Sax <mjsax@apache.org> wrote:

> Hi,
>
> I cannot run WordCountLocal example of flink-storm-example in Eclipse.
> The ITCase for it works, but it is using a test environment. If I start
> WordCountLocal directly it uses FlinkMiniCluster and I get the following
> exception:
>
> >
> org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException:
> Not enough free slots available to run the job. You can decrease the
> operator parallelism or increase the number of slots per TaskManager in the
> configuration. Task to schedule: < Attempt #0 (tokenizer (2/4)) @
> (unassigned) - [SCHEDULED] > with groupID <
> e86ddd0aa99173f6781be2bce861e897 > in sharing group < SlotSharingGroup
> [d740211315a07b8e0ee58abb480ee0c4, 6031cd5b189d5a0f46afdc1913660dad,
> 94b1c37969b9bb3d66e5c09099fa04a2, e86ddd0aa99173f6781be2bce861e897] >.
> Resources available to scheduler: Number of instances=1, total number of
> slots=1, available slots=0
>
> I have no idea how to fix this. Any help on this, would be great.
>
>
> -Matthias
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message