Mailing-List: contact user-help@flink.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Ajay Tripathy <ajayt@yelp.com>
Date: Fri, 4 Aug 2017 15:51:29 -0700
Message-ID: <CAHLEDaJBTfL69=M3Qj+SQiKr1puYq1RDU7=_UNmnOXM0W7d-wA@mail.gmail.com>
Subject: JMX stats reporter with all task manager/job manager stats aggregated?
To: user@flink.apache.org
Content-Type: multipart/alternative; boundary="94eb2c1b4eb47f12fd0555f55680"
archived-at: Fri, 04 Aug 2017 22:51:35 -0000

--94eb2c1b4eb47f12fd0555f55680
Content-Type: text/plain; charset="UTF-8"

Hi, I'm running flink jobmanagers/taskmanagers with yarn. I've turned on
the JMX reporter in my flink-conf.yaml as follows:

metrics.reporters: jmx

metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReporter


I was wondering:

Is there a JMX server with the aggregated stats across all jobs / tasks? If
so, where is it located? It appears that a JMX starts for every single
taskmanager and the jobmanagers do not have the data reported from the
taskmanagers.


I'm not sure if this is related, but when I try to specify a port for the
jmx reporter, like this:

metrics.reporter.jmx.port: 8789

I'm receiving an error where JMX servers from different task managers fight
for that port, and fail to start.

--94eb2c1b4eb47f12fd0555f55680
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi, I&#39;m running flink jobmanagers/taskmanagers with ya=
rn. I&#39;ve turned on the JMX reporter in my flink-conf.yaml as follows:<d=
iv><br></div><div>


<p class=3D"gmail-p1"><span class=3D"gmail-s1">metrics.reporters</span><spa=
n class=3D"gmail-s2">:</span><span class=3D"gmail-s3"> jmx</span></p>
<p class=3D"gmail-p2"><span class=3D"gmail-s4">metrics.reporter.jmx.class</=
span><span class=3D"gmail-s2">:</span><span class=3D"gmail-s1"> org.apache.=
flink.metrics.jmx.JMXReporter</span></p><p class=3D"gmail-p2"><br></p><p cl=
ass=3D"gmail-p2">I was wondering:</p><p class=3D"gmail-p2">Is there a JMX s=
erver with the aggregated stats across all jobs / tasks? If so, where is it=
 located? It appears that a JMX starts for every single taskmanager and the=
 jobmanagers do not have the data reported from the taskmanagers.</p><p cla=
ss=3D"gmail-p2"><br></p><p class=3D"gmail-p2">I&#39;m not sure if this is r=
elated, but when I try to specify a port for the jmx reporter, like this:</=
p><p class=3D"gmail-p2">metrics.reporter.jmx.port: 8789</p><p class=3D"gmai=
l-p2">I&#39;m receiving an error where JMX servers from different task mana=
gers fight for that port, and fail to start.</p></div></div>

--94eb2c1b4eb47f12fd0555f55680--