In general, have you had a look at the giraph.metrics.enable option? It prints out metrics after each superstep to each worker's system.out log.-------- Ursprüngliche Nachricht --------Von: Steven HarenbergDatum:14.01.2015 19:55 (GMT+01:00)An: userBetreff: Performance metrics / calling external scriptsHi all,I am attempting to measure some performance metrics (such as runtime, memory usage, network communication, etc.) using an external bash script that grabs some machine stats.I am having difficulty figuring out where to externally call this script in Giraph. Particularly, I would like to call it at several key points in Giraph's execution, such as input/setup, beginning of computation, and output. The issue I am having is that I can't clearly figure out where to place the external calls because I can't figure out where these "phases" are actually happening in Giraph's source.I also have the added difficulty that I only want this external script to be called for each machine/worker not for each thread. Meaning, it should not be inside the vertex computation code, for example.Summary: my goal is to call an external script once per machine at the beginning of setup, computation (at/before superstep 0), and output.
- Is this possible?
- If so, could anyone please point me to where these phases are happening that would work for making such an external call? I am guessing this would be the MasterThread file, as this is where all the GiraphTimers are happening.
- Any general advice would be appreciated.Thanks and regards,Steve