spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Bozarth (JIRA)" <>
Subject [jira] [Commented] (SPARK-18551) Add functionality to delete event logs from the History Server UI
Date Mon, 28 Nov 2016 20:36:59 GMT


Alex Bozarth commented on SPARK-18551:

Thanks for the feedback [~vanzin], I've paused work on my PR while we discuss what you've
brought up. 

For your first point, my thinking was that the person who started the SHS and enabled the
deletion config would be the liable user. This would/should be clearly documented. This means
that in would be on the "sysadmin" who started the SHS to secure the SHS since anyone with
access could delete apps. 
I'm not quite sure what you mean about the UI's auth code though, are you referring to the
security manager? Since the security manager was already instantiated in the history server
I assumed it was fair to use, though again it only looks at the startup user.

The second point is one I hadn't thought of though, as long as it's documented as such I don't
see the issue with the logs showing the SHS user for every deletion. I agree that trying to
get the web user's username to the logs is lots of unnecessary work.

The use case that raised this issue is when a user is given a SHS by their admin to access
their app ui's and it only shows their apps and only they (and the admin) can access it. The
user here has no access to the log folder without going through their admin.

As for []'s GET comment, I plan to fix that, it was a leftover from [~srowen]'s
update to the kill stage code that I kept because (at the time) I didn't understand its purpose
(Its for YARN, which doesn't apply here). 

If you still think this is an unsalvageable idea I will close this, I respect your opinion

> Add functionality to delete event logs from the History Server UI
> -----------------------------------------------------------------
>                 Key: SPARK-18551
>                 URL:
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core, Web UI
>            Reporter: Alex Bozarth
> Sometimes a Spark user will only have access to a History Server to interact with their
(past) applications. But without access to the server they can only delete applications through
use of the FS Cleaner feature, which itself can only clean logs older than a set date. 
> I propose adding the ability to delete specific applications via the History Server UI
with the default setting to off.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message