lucene-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Risden (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-13989) Move all hadoop related code to a contrib module
Date Tue, 03 Dec 2019 03:38:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-13989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986582#comment-16986582
] 

Kevin Risden commented on SOLR-13989:
-------------------------------------

{quote}At least I'm not that ambitious here. This ain't my first rodeo, and I think step zero
is to first get "something" very basic and flat into production before trying to add a bunch
of specialized java security code.
{quote}
{quote}But I don't want to throw a bunch of scary ass infrastructure (which might be viewed
as overengineering) at the project, i'd rather iterate slowly.
{quote}
Definitely on the same page here. Progress over perfection wins every time. Just throwing
out an idea since had experience on the ES side with Hadoop.
{quote}And yes, hadoop presents a real practical challenge. Its the least secure code i've
ever dealt with (sorry). its a nightmare for anything that has it as a dependency. Its like
the developers just didn't care.
{quote}
Not going to disagree here at all. Both on the dependency level (pulls in a lot of crap) and
at the implementation level there is lot of room for improvement. It might be possible to
get some of the fixes for security manager upstream (ie: HADOOP-12888). Solr is really only
a client to Hadoop/HDFS (except in tests).
{quote} And I absolutely don't want to discourage you from helping with the effort.
{quote}
No worries definitely not discouraged. I'm glad its being worked on. It is an area I've been
following for a while - ES, Solr, and Hadoop. I'll definitely help out where I can. Its not
currently my day job, but have spare cycles to help out.

> Move all hadoop related code to a contrib module
> ------------------------------------------------
>
>                 Key: SOLR-13989
>                 URL: https://issues.apache.org/jira/browse/SOLR-13989
>             Project: Solr
>          Issue Type: Task
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: Hadoop Integration
>            Reporter: Shalin Shekhar Mangar
>            Priority: Major
>             Fix For: master (9.0)
>
>
> Spin off from SOLR-13986:
> {quote}
> It seems really important to move or remove this hadoop shit out of the solr core: It
is really unreasonable that solr core depends on hadoop. that's gonna simply block any progress
improving its security, because solr code will get dragged down by hadoop's code.
> {quote}
> We should move all hadoop related dependencies to a separate contrib module



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org


Mime
View raw message