Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Subject: Re: Bypassing ExtractingRequestHandler
To: solr-user@lucene.apache.org
References: <CAKQjkwckWLzQS754qxQM=3Ri8=idjxm4VqOxXC+b0BsCvmZAkQ@mail.gmail.com>
From: Charlie Hull <charlie@flax.co.uk>
Message-ID: <77a2386d-21de-60f2-e497-97b39873131e@flax.co.uk>
Date: Fri, 10 Jun 2016 09:22:04 +0100
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101
 Thunderbird/45.1.1
MIME-Version: 1.0
In-Reply-To: <CAKQjkwckWLzQS754qxQM=3Ri8=idjxm4VqOxXC+b0BsCvmZAkQ@mail.gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
archived-at: Fri, 10 Jun 2016 08:22:11 -0000

On 10/06/2016 02:20, Justin Lee wrote:
> Has anybody had any experience bypassing ExtractingRequestHandler and
> simply managing Tika manually?  I want to make a small modification to Tika
> to get and save additional data from my PDFs, but I have been
> procrastinating in no small part due to the unpleasant prospect of setting
> up a development environment where I could compile and debug modifications
> that might run through PDFBox, Tika, and ExtractingRequestHandler.  It
> occurs to me that it would be much easier if the two were separate, so I
> could have direct control over Tika and just submit the text to Solr after
> extraction.  Am I going to regret this approach?  I'm not sure what
> ExtractingRequestHandler really does for me that Tika doesn't already do.

We tend to prefer running Tika externally as it's entirely possible that 
Tika will crash or hang with certain files - and that will bring down 
Solr if you're running Tika within it. Here's a Dropwizard wrapper 
around Tika that might be of use:
https://github.com/mattflax/dropwizard-tika-server

Cheers

Charlie
>
> Also, I was reading this
> <http://stackoverflow.com/questions/33292776/solr-tika-processor-not-crawling-my-pdf-files-prefectly>
> stackoverflow entry and someone offhandedly mentioned that
> ExtractingRequestHandler might be separated in the future anyway. Is there
> a public roadmap for the project, or does one have to keep up with the
> developer's mailing list and hunt through JIRA entries to keep up with the
> pulse of the project?
>
> Thanks,
> Justin
>


-- 
Charlie Hull
Flax - Open Source Enterprise Search

tel/fax: +44 (0)8700 118334
mobile:  +44 (0)7767 825828
web: www.flax.co.uk