Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (nike.apache.org: local policy)
From: Francis Yakin <fyakin@liquid.com>
To: "'solr-user@lucene.apache.org'" <solr-user@lucene.apache.org>
Date: Wed, 1 Jul 2009 21:19:32 -0700
Subject: RE: Is there any other way to load the index beside using "http"
 	connection?
Thread-Topic: Is there any other way to load the index beside using "http"
 	connection?
Thread-Index: Acn6wiVEcxAUfNp5Q8C0LNrZuzLscwACXb/g
Message-ID: 
 <99238C967BA6FB449F2C8349A1DB334D28778F3FBA@CORP-MAILBOX.liquid.com>
References: 
 <99238C967BA6FB449F2C8349A1DB334D28778F3FB0@CORP-MAILBOX.liquid.com>
 <5e76f3840907012006t3896e4beg9b05d8ee95fb05e2@mail.gmail.com>
In-Reply-To: <5e76f3840907012006t3896e4beg9b05d8ee95fb05e2@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
acceptlanguage: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0


Glen,

Database we use is Oracle, I am not the database administrator, so I don't =
familiar with their script.
SO, basically we have the Oracle SQL script to load the XML files over HTTP=
 connection to our Solr Master.

My question is there any other way instead of using HTTP connection to load=
 the XML files to our SOLR Master?

You mentioned about LuSql, I am not familiar with that. Can you provide us =
the docs or something? Again I am not the database Guys, I am only the solr=
 Guy. The database we have is a different box than Solr master and both are=
 running linux(RedHat).

Thanks

Francis

-----Original Message-----
From: Glen Newton [mailto:glen.newton@gmail.com]
Sent: Wednesday, July 01, 2009 8:06 PM
To: solr-user@lucene.apache.org
Subject: Re: Is there any other way to load the index beside using "http" c=
onnection?

You can directly load to the backend Lucene using LuSql[1]. It is
faster than Solr, sometimes as much as an order of magnitude faster.

Disclosure: I am the author of LuSql

-Glen
http://zzzoot.blogspot.com/

[1]http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql

2009/7/1 Francis Yakin <fyakin@liquid.com>:
>
> We have several thousands of  xml files in database that we load it to so=
lr master
> The Database uses "http"  connection and transfer those files to solr mas=
ter. Solr then  translate xml files to their lindex.
>
> We are experiencing issue with close/open connection in the firewall and =
very very slow.
>
> Is there any other way to load the data/index from Database to solr maste=
r beside using http connection, so it means we just scp/ftp the xml file  f=
rom Database system to solr master  and let solr convert those to lucene in=
dexes?
>
> Any input or help will be much appreciated.
>
>
> Thanks
>
> Francis
>
>
>
>


--

-