lucene-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Risden (Jira)" <>
Subject [jira] [Commented] (SOLR-13989) Move all hadoop related code to a contrib module
Date Tue, 03 Dec 2019 03:38:00 GMT


Kevin Risden commented on SOLR-13989:

{quote}At least I'm not that ambitious here. This ain't my first rodeo, and I think step zero
is to first get "something" very basic and flat into production before trying to add a bunch
of specialized java security code.
{quote}But I don't want to throw a bunch of scary ass infrastructure (which might be viewed
as overengineering) at the project, i'd rather iterate slowly.
Definitely on the same page here. Progress over perfection wins every time. Just throwing
out an idea since had experience on the ES side with Hadoop.
{quote}And yes, hadoop presents a real practical challenge. Its the least secure code i've
ever dealt with (sorry). its a nightmare for anything that has it as a dependency. Its like
the developers just didn't care.
Not going to disagree here at all. Both on the dependency level (pulls in a lot of crap) and
at the implementation level there is lot of room for improvement. It might be possible to
get some of the fixes for security manager upstream (ie: HADOOP-12888). Solr is really only
a client to Hadoop/HDFS (except in tests).
{quote} And I absolutely don't want to discourage you from helping with the effort.
No worries definitely not discouraged. I'm glad its being worked on. It is an area I've been
following for a while - ES, Solr, and Hadoop. I'll definitely help out where I can. Its not
currently my day job, but have spare cycles to help out.

> Move all hadoop related code to a contrib module
> ------------------------------------------------
>                 Key: SOLR-13989
>                 URL:
>             Project: Solr
>          Issue Type: Task
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: Hadoop Integration
>            Reporter: Shalin Shekhar Mangar
>            Priority: Major
>             Fix For: master (9.0)
> Spin off from SOLR-13986:
> {quote}
> It seems really important to move or remove this hadoop shit out of the solr core: It
is really unreasonable that solr core depends on hadoop. that's gonna simply block any progress
improving its security, because solr code will get dragged down by hadoop's code.
> {quote}
> We should move all hadoop related dependencies to a separate contrib module

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message