flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saliya Ekanayake <esal...@gmail.com>
Subject Re: Parameters to Control Intra-node Parallelism
Date Thu, 30 Jun 2016 21:27:30 GMT
Thank you, I'll check these.

In 2.) you said they are likely to exchange through memory. Is there a case
why they wouldn't?

On Thu, Jun 30, 2016 at 5:03 AM, Ufuk Celebi <uce@apache.org> wrote:

> On Thu, Jun 30, 2016 at 1:44 AM, Saliya Ekanayake <esaliya@gmail.com>
> wrote:
> > 1. What parameters are available to control parallelism within a node?
>
> Task Manager processing slots:
>
> https://ci.apache.org/projects/flink/flink-docs-release-1.0/setup/config.html#configuring-taskmanager-processing-slots
>
> > 2. Does Flink support shared memory-based messaging within a node
> (without
> > doing TCP calls)?
>
> Yes, local exchanges happen via memory and not TCP, for example if you
> have a map-reduce, map subtask 1 and reduce subtask 1 are likely to
> exchange data locally.
>
> > 3. Is there support for Infiniband interconnect?
>
> No, not that I'm aware of.
>
> – Ufuk
>



-- 
Saliya Ekanayake
Ph.D. Candidate | Research Assistant
School of Informatics and Computing | Digital Science Center
Indiana University, Bloomington

Mime
View raw message