manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jack Krupansky" <jack.krupan...@lucidimagination.com>
Subject Re: Setting up Solr -- commit
Date Wed, 02 Jun 2010 15:15:27 GMT
I did in fact try setting commit in the Solr output connection arguments a month ago. It kind
of worked, but Solr gave some errors on occasion due to overlapping requests - one request
did a commit while other parallel requests from LCF were in various stages of processing.
I do not recall whether I tried to set JVM throttling to 1 to force sequential processing
of posted documents, but you don't really want to have to force sequential processing anyway.

Side note to Solr guys: What is the "contract" for the ExtractingRequestHandler in terms of
handling parallel requests? Is it "the more the merrier" (including lots of PDF files?), or
are there specific issues that the client must/should worry about? There is also the potential
for multiple clients, LCF or other, simultaneously blasting at /update/extract. Obviously
those clients can't know what each other is up to.

-- Jack Krupansky


From: karl.wright@nokia.com 
Sent: Wednesday, June 02, 2010 9:01 AM
To: connectors-user@incubator.apache.org 
Subject: RE: Setting up Solr


You can send any argument you want by configuring the output connector.  However, the explicit
commit on every post will slow down performance of your crawls.

 

Karl

 

From: ext Rohan.GPatil@cognizant.com [mailto:Rohan.GPatil@cognizant.com] 
Sent: Wednesday, June 02, 2010 9:00 AM
To: connectors-user@incubator.apache.org
Subject: RE: Setting up Solr

 

Hi,

 

Yes that is where I was stuck up.. making an explicit commit.. 

 

Can I send the argument commit=true while configuring the Repo connector.

 

Thanks & Regards,

Rohan G Patil

Cognizant  Programmer Analyst Trainee,Bangalore || Mob # +91 9535577001 

Rohan.GPatil@cognizant.com

 

From: Jack Krupansky [mailto:jack.krupansky@lucidimagination.com] 
Sent: Wednesday, June 02, 2010 4:42 PM
To: connectors-user@incubator.apache.org
Subject: Re: Setting up Solr

 

A short Solr tutorial is here:

 

http://lucene.apache.org/solr/tutorial.html

After running an LCF job that uses a Solr output connection, be sure to manually force a Solr
"commit", for example:

 

    cd .../apache-solr-1.4.0/example/exampledocs
    java -jar post.jar


-- Jack Krupansky

 

From: Rohan.GPatil@cognizant.com 

Sent: Wednesday, June 02, 2010 1:46 AM

To: connectors-user@incubator.apache.org 

Subject: Setting up Solr

 

Hi,

 

I am stuck at setting up the Solr server to be used with LCF.

 

I am new to Solr.

 

Thanks & Regards,

Rohan G Patil

Cognizant  Programmer Analyst Trainee,Bangalore || Mob # +91 9535577001 

Rohan.GPatil@cognizant.com

 

      This e-mail and any files transmitted with it are for the sole use of 
      the intended recipient(s) and may contain confidential and privileged 
      information.
      If you are not the intended recipient, please contact the sender by 
      reply e-mail and destroy all copies of the original message.
      Any unauthorized review, use, disclosure, dissemination, forwarding, 
      printing or copying of this email or any action taken in reliance on this 
      e-mail is strictly prohibited and may be unlawful.
     

 

      This e-mail and any files transmitted with it are for the sole use of 
      the intended recipient(s) and may contain confidential and privileged 
      information.
      If you are not the intended recipient, please contact the sender by 
      reply e-mail and destroy all copies of the original message.
      Any unauthorized review, use, disclosure, dissemination, forwarding, 
      printing or copying of this email or any action taken in reliance on this 
      e-mail is strictly prohibited and may be unlawful.


     

 

Mime
View raw message