giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From José Luis Larroque <larroques...@gmail.com>
Subject Stop Giraph application when reach certain amount of time
Date Wed, 25 Jan 2017 03:26:28 GMT
I have to execute several *Giraph* process in *AWS*. For doing it, i have a
script that launch one process after another until all process are
finished. The problem is that some times, a container gets killed, and i
spent a lot of time waiting for the entire giraph app gets killed, so the
following can start. I'm trying to diminish this time, because i know that
a process that takes more than 5 minutes isn't going to be ended (i prefer
get a few giraph process being killed, if the maximum time for executing
all of them gets reduced significantly).

I already try putting a "maximum amount of time" with the following options
putting a really low value (1 milisecond):

   - *giraph.waitTaskDoneTimeoutMs* -> This option make the container throw
   an IllegalStateException but doens's stop the Giraph app from running. I
   know that this option have a bug
   <https://www.google.com.ar/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=0ahUKEwiQ_b29q9zRAhUFhJAKHRteDhIQFggYMAA&url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FGIRAPH-831&usg=AFQjCNG45HxFVY5THaLNP5w4KIZTPuMROQ&sig2=NtyqYo4XIGxafQcPhSyLCw&bvm=bv.145063293,d.Y2I>
reported,
   but i hope that is not the case here.
   - *giraph.maxAllowedJobTimeMilliseconds* -> With LOG level in DEBUG, i
   couldn't see any impact of using this option.

But yet, i'm not getting the expected result, and i have Giraph
applications that take like 12000 seconds or more (a big waste of time,
resources and money).


Any help will be greatly appreciated.


Thanks!

-- 
*José Luis Larroque*
Analista Programador Universitario - Facultad de Informática - UNLP
Desarrollador Java  en LIFIA

Mime
View raw message