spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yu Wei <yu20...@hotmail.com>
Subject Spark on mesos, it seemed spark dispatcher didn't abort when authorization failed
Date Tue, 27 Dec 2016 02:50:12 GMT
Hi Guys,


When running some cases about spark on mesos, it seemed that spark dispatcher didn't abort
when authorization failed.

It seemed that spark dispatcher detected the error but did not handle it properly.

The detailed log is as below,

16/12/26 16:02:08 INFO Utils: Successfully started service on port 8081.
16/12/26 16:02:08 INFO MesosClusterUI: Bound MesosClusterUI to 0.0.0.0, and started at http://192.168.111.192:8081
I1226 16:02:08.861893 11966 sched.cpp:232] Version: 1.2.0
I1226 16:02:08.868672 11964 sched.cpp:336] New master detected at master@192.168.111.191:5050
I1226 16:02:08.870041 11964 sched.cpp:402] Authenticating with master master@192.168.111.191:5050
I1226 16:02:08.870066 11964 sched.cpp:409] Using default CRAM-MD5 authenticatee
I1226 16:02:08.870635 11959 authenticatee.cpp:97] Initializing client SASL
I1226 16:02:08.871201 11959 authenticatee.cpp:121] Creating new client SASL connection
I1226 16:02:08.971091 11964 authenticatee.cpp:213] Received SASL authentication mechanisms:
CRAM-MD5
I1226 16:02:08.971156 11964 authenticatee.cpp:239] Attempting to authenticate with mechanism
'CRAM-MD5'
I1226 16:02:08.972964 11962 authenticatee.cpp:259] Received SASL authentication step
I1226 16:02:08.974642 11957 authenticatee.cpp:299] Authentication success
I1226 16:02:08.975075 11964 sched.cpp:508] Successfully authenticated with master master@192.168.111.191:5050
I1226 16:02:08.977557 11960 sched.cpp:1177] Got error 'Not authorized to use role 'spark''
I1226 16:02:08.977583 11960 sched.cpp:2042] Asked to abort the driver
16/12/26 16:02:08 ERROR MesosClusterScheduler: Error received: Not authorized to use role
'spark'
I1226 16:02:08.978495 11960 sched.cpp:1223] Aborting framework
16/12/26 16:02:08 INFO MesosClusterScheduler: driver.run() returned with code DRIVER_ABORTED
16/12/26 16:02:08 INFO Utils: Successfully started service on port 7077.
16/12/26 16:02:08 INFO MesosRestServer: Started REST server for submitting applications on
port 7077


It seems this is bug.


Thanks,

Jared, (??)
Software developer
Interested in open source software, big data, Linux

Mime
View raw message