This happens automatically as long as you submit with cluster mode instead of client mode.
(e.g. ./spark-submit —master yarn-cluster …)
The property you mention would help right after that, although you will need to set it to
a large value (e.g. 1000?) - as there is no “infinite” support.
-adrian
From: Jeetendra Gangele
Date: Thursday, October 1, 2015 at 4:30 PM
To: user
Subject: automatic start of streaming job on failure on YARN
We've a streaming application running on yarn and we would like to ensure that is up running
24/7.
Is there a way to tell yarn to automatically restart a specific application on failure?
There is property yarn.resourcemanager.am.max-attempts which is default set to 2 setting it
to bigger value is the solution? Also I did observed this does not seems to work my application
is failing and not starting automatically.
Mesos has this build in support wondering why yarn is lacking here?
Regards
jeetendra
|