Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@flink.apache.org
Subject: Re: How to use all available task managers
To: user@flink.apache.org
References: 
 <CAKZehoWEUEpt2OKgsh79+-+ns2mP4YZstZXhYo5JNFPE8qHtnQ@mail.gmail.com>
 <CAC27z=Nzv=nN2wnsqVp3i83W7s+wtzS8f2rNJwiXe44omccBVw@mail.gmail.com>
 <CAKZehoXSS5qabeXn983AT28tj5E=hK2OvM+bb0Qtr6eFX4Va9A@mail.gmail.com>
 <CAKiyyaHGpyp4mxkAhtQUSA-+7bDRCCd+nDVZ6q-MqR0zXMrS1Q@mail.gmail.com>
 <CAKZehoWFsD_C_Z7F5FgQv87eq5MDXrpEd7MHoDv6ACcuGumLmg@mail.gmail.com>
From: "Matthias J. Sax" <mjsax@apache.org>
Message-ID: <56CE14E0.5050408@apache.org>
Date: Wed, 24 Feb 2016 21:38:56 +0100
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101
 Icedove/38.5.0
MIME-Version: 1.0
In-Reply-To: 
 <CAKZehoWFsD_C_Z7F5FgQv87eq5MDXrpEd7MHoDv6ACcuGumLmg@mail.gmail.com>
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="AE2M4xdtPdkB6UCeJ9EFEBkTGm1Hc6tkL"

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--AE2M4xdtPdkB6UCeJ9EFEBkTGm1Hc6tkL
Content-Type: multipart/mixed; boundary="GOe7iKCiNDxwTOqcCqooQbhpR6l6WDJUf"
From: "Matthias J. Sax" <mjsax@apache.org>
To: user@flink.apache.org
Message-ID: <56CE14E0.5050408@apache.org>
Subject: Re: How to use all available task managers
References: <CAKZehoWEUEpt2OKgsh79+-+ns2mP4YZstZXhYo5JNFPE8qHtnQ@mail.gmail.com>
 <CAC27z=Nzv=nN2wnsqVp3i83W7s+wtzS8f2rNJwiXe44omccBVw@mail.gmail.com>
 <CAKZehoXSS5qabeXn983AT28tj5E=hK2OvM+bb0Qtr6eFX4Va9A@mail.gmail.com>
 <CAKiyyaHGpyp4mxkAhtQUSA-+7bDRCCd+nDVZ6q-MqR0zXMrS1Q@mail.gmail.com>
 <CAKZehoWFsD_C_Z7F5FgQv87eq5MDXrpEd7MHoDv6ACcuGumLmg@mail.gmail.com>
In-Reply-To: <CAKZehoWFsD_C_Z7F5FgQv87eq5MDXrpEd7MHoDv6ACcuGumLmg@mail.gmail.com>

--GOe7iKCiNDxwTOqcCqooQbhpR6l6WDJUf
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Could it be, that you would need to edit client local flink-conf.yaml
instead of the TaskManager config files? (In case, you do not want to
specify parallelism via env.setParallelism(int);)

-Matthias

On 02/24/2016 04:19 PM, Saiph Kappa wrote:
> Thanks! It worked now :-)
>=20
> On Wed, Feb 24, 2016 at 2:48 PM, Ufuk Celebi <uce@apache.org
> <mailto:uce@apache.org>> wrote:
>=20
>     You can use the environment to set it the job parallelism to 6 e.g.=

>     env.setParallelism(6).
>=20
>     Setting this will override the default behaviour. Maybe that's why =
the
>     default parallelism is not working... you might have it set to 1
>     already?
>=20
>     On Wed, Feb 24, 2016 at 3:41 PM, Saiph Kappa <saiph.kappa@gmail.com=

>     <mailto:saiph.kappa@gmail.com>> wrote:
>     > I set "parallelism.default: 6" on flink-conf.yaml of all 6
>     machines, and
>     > still, my job only uses 1 task manager. Why?
>     >
>     >
>     > On Wed, Feb 24, 2016 at 8:31 AM, Till Rohrmann
>     <trohrmann@apache.org <mailto:trohrmann@apache.org>> wrote:
>     >>
>     >> Hi Saiph,
>     >>
>     >> I think the configuration value should be parallelism.default: 6=
=2E
>     That
>     >> will execute jobs which have not parallelism defined with a DOP =
of 6.
>     >>
>     >> Cheers,
>     >> Till
>     >>
>     >>
>     >> On Wed, Feb 24, 2016 at 1:43 AM, Saiph Kappa
>     <saiph.kappa@gmail.com <mailto:saiph.kappa@gmail.com>>
>     >> wrote:
>     >>>
>     >>> Hi,
>     >>>
>     >>> I  am running a flink stream application on a cluster with 6
>     slaves/task
>     >>> managers. I have set in flink-conf.yaml of every machine
>     >>> "parallelization.degree.default: 6". However, when I run my
>     application it
>     >>> just uses one task slot and not all of them. Am I missing somet=
hing?
>     >>>
>     >>> Thanks.
>     >>
>     >>
>     >
>=20
>=20


--GOe7iKCiNDxwTOqcCqooQbhpR6l6WDJUf--

--AE2M4xdtPdkB6UCeJ9EFEBkTGm1Hc6tkL
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBCAAGBQJWzhTlAAoJEFCVK48prEZ47egP/R0/giaEfyFXnBBlvXb/Uw/z
ju04vbBOtLtynAUEMCxkI25X9YazjXkKsILElt4jqlVG+kFt8zw/2SnUNRe94n/7
yU29jcctCCIPLScdMCpezFnJ9wyXeDxrB4j6ZReCMoH3GqdwtmozR/oVD8TVin3q
JSujUCRhNeqOaraZHXB9Uj7tJnfBpBbXTGInkqZVILCDIdVm8Lah+NSyCwlWN52b
tc7vVwKqa14tG6toiy89ktLn9QIelyr8J9RyE3Z85uPdoXhVGtBGJQEtKaMd+aIa
GYOq49nOaTwY93Vs+/bEIBWNLfbpGU9pOLkjFgjkMS1PRcBuCMTymQF6K3PTpmF4
JUv7ljvSVbrItyqGm8iD+qt6P4eA7a4mTh5/g2BtbTpy9adalRrHNGtbK9N1W7tg
1Z+P3vVshpOgE+RFWYIo7RET86iHCu58f6UDumT47lGLECoiZZkRBC/NuM0XR6+x
kJ9/Ph2iAxFo5bTtHfmCq3kmEFzI7uUkgaj6AZwOXH9gP37xKCq9Qk7U0v6U82yB
leKXm+WT63NrqpgkvVGyAk+mZOzZvNTpY5iBfYZE1EwrXoCkYikKK/uJaSxnJkpk
8LaVK5KUQdEo+CeBmC/LebohtOiRTs4jvqJG8OU8r7YuWugxyIXLdVRjKt0qaOiT
Js9pD7NgMniI4Y/Vbaov
=mKd/
-----END PGP SIGNATURE-----

--AE2M4xdtPdkB6UCeJ9EFEBkTGm1Hc6tkL--