lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Noble Paul നോബിള്‍ नोब्ळ् <noble.p...@corp.aol.com>
Subject Re: Indexing from DB connection issue
Date Wed, 27 May 2009 14:44:13 GMT
all I can suggest is write a simple jdbc program and see if it works
from that m/c( any privilege issue etc?)

On Wed, May 27, 2009 at 7:15 PM, ahammad <ahmed.hammad@gmail.com> wrote:
>
> Hello,
>
> I tried your suggestion, and it still gives me the same error.
>
> I'd like to point out again that the same folder/config setup is running on
> my machine with no issues, but it gives me that stack trace in the logs on
> the server.
>
> When I do the full data import request through the browser, I get this:
>
> <response>
> −
> <lst name="responseHeader">
> <int name="status">0</int>
> <int name="QTime">0</int>
> </lst>
> −
> <lst name="initArgs">
> −
> <lst name="defaults">
> <str name="config">data-config.xml</str>
> </lst>
> </lst>
> <str name="command">full-import</str>
> <str name="status">idle</str>
> <str name="importResponse"/>
> −
> <lst name="statusMessages">
> <str name="Time Elapsed">0:0:1.329</str>
> <str name="Total Requests made to DataSource">1</str>
> <str name="Total Rows Fetched">0</str>
> <str name="Total Documents Processed">0</str>
> <str name="Total Documents Skipped">0</str>
> <str name="Full Dump Started">2009-05-27 09:42:24</str>
> </lst>
> −
> <str name="WARNING">
> This response format is experimental.  It is likely to change in the future.
> </str>
> </response>
>
>
> Refreshing the page usually results in requests to datasource/rows fetched
> etc numbers to increase. In my case the request to datasource stays at 1
> regardless. Looks like it tries once and fails, then it terminates the
> process...
>
> Regards
>
>
> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>>
>> no need to rename .
>>
>> On Wed, May 27, 2009 at 6:50 PM, ahammad <ahmed.hammad@gmail.com> wrote:
>>>
>>> Would I need to rename it or refer to it somewhere? Or can I keep the
>>> existing name (apache-solr-dataimporthandler-1.4-dev.jar)?
>>>
>>> Cheers
>>>
>>>
>>> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>>>>
>>>> take the trunk dih.jar. use  winzip/winrar or any tool and just delete
>>>> all the files other than ClobTransformer.class. put that jar into
>>>> solr.home/lib
>>>>
>>>> On Wed, May 27, 2009 at 6:10 PM, ahammad <ahmed.hammad@gmail.com> wrote:
>>>>>
>>>>> Hmmm, that's probably a good idea...although it does not explain how
my
>>>>> current local setup works.
>>>>>
>>>>> Can you please explain how this is done? I am assuming that I need to
>>>>> add
>>>>> the class itself to the source of solr 1.3, and then compile the code,
>>>>> and
>>>>> take the new .war file and put it in Tomcat? If that is correct, where
>>>>> in
>>>>> the source folders would the ClobTransformer.class file go?
>>>>>
>>>>> Thanks.
>>>>>
>>>>>
>>>>>
>>>>> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>>>>>>
>>>>>> I guess it is better to copy the ClobTransformer.class  alone and
use
>>>>>> the old Solr1.3 DIH
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, May 26, 2009 at 11:50 PM, ahammad <ahmed.hammad@gmail.com>
>>>>>> wrote:
>>>>>>>
>>>>>>> I have an update:
>>>>>>>
>>>>>>> I played around with it some more and it seems like it's being
caused
>>>>>>> by
>>>>>>> the
>>>>>>> ClobTransformer. If I remove the 'clob="true"' from the field
part in
>>>>>>> the
>>>>>>> data-config, it works fine.
>>>>>>>
>>>>>>> The Solr install is a multicore one. I placed the
>>>>>>> apache-solr-dataimporthandler-1.4-dev.jar from the nightly builds
in
>>>>>>> the
>>>>>>> {solrHome}/core1/lib directory (I only need it for the first
core).
>>>>>>> Is
>>>>>>> there
>>>>>>> something else I need to do for it to work?
>>>>>>>
>>>>>>> I don't recall doing an additional step when I did this a few
weeks
>>>>>>> ago
>>>>>>> on
>>>>>>> my local machine.
>>>>>>>
>>>>>>> Any help is appreciated.
>>>>>>>
>>>>>>> Regards
>>>>>>>
>>>>>>>
>>>>>>> ahammad wrote:
>>>>>>>>
>>>>>>>> Hello all,
>>>>>>>>
>>>>>>>> I am tyring to index directly from an Oracle DB. This is
what
>>>>>>>> appears
>>>>>>>> in
>>>>>>>> the stack trace:
>>>>>>>>
>>>>>>>> SEVERE: Full Import failed
>>>>>>>> org.apache.solr.handler.dataimport.DataImportHandlerException:
>>>>>>>> Unable
>>>>>>>> to
>>>>>>>> execute query: select * from ARTICLE Processing Document
# 1
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:186)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:143)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:43)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:74)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:285)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:178)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:136)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:334)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:386)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:377)
>>>>>>>> Caused by: java.sql.SQLException: Closed Connection
>>>>>>>>       at
>>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)
>>>>>>>>       at
>>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146)
>>>>>>>>       at
>>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:208)
>>>>>>>>       at
>>>>>>>> oracle.jdbc.driver.PhysicalConnection.createStatement(PhysicalConnection.java:755)
>>>>>>>>       at
>>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:174)
>>>>>>>>       ... 10 more
>>>>>>>>
>>>>>>>> Funny thing is, the data import works on my local machine.
I moved
>>>>>>>> all
>>>>>>>> the
>>>>>>>> config files to another server, and I get this. I reindexed
on my
>>>>>>>> local
>>>>>>>> machine immediately after in order to verify that the DB
works, and
>>>>>>>> it
>>>>>>>> indexes fine.
>>>>>>>>
>>>>>>>> Here is my data-config file, just in case:
>>>>>>>>
>>>>>>>> <dataConfig>
>>>>>>>>     <dataSource driver="oracle.jdbc.driver.OracleDriver"
>>>>>>>> url="xxxxxxx"
>>>>>>>> user="xxxxxxx" password="xxxxxxx"/>
>>>>>>>>     <document name="articles">
>>>>>>>>             <entity name="ARTICLE" pk="ID" query="select
* from
>>>>>>>> ARTICLE"
>>>>>>>> transformer="ClobTransformer">
>>>>>>>>                               <field column="TITLE"
name="title" />
>>>>>>>>                               <field column="BODY"
name="body"
>>>>>>>> clob="true" />
>>>>>>>>                               <field column="ID"
name="id" />
>>>>>>>>
>>>>>>>>                               <entity name="ARTICLE_AUTHOR"
>>>>>>>> query="select ID_A from ARTICLE_AUTHOR
>>>>>>>> where ID_A='${ARTICLE.ID}'">
>>>>>>>>                                      
 <field column="ID_A"
>>>>>>>> name="author"  />
>>>>>>>>                               </entity>
>>>>>>>>
>>>>>>>>         </entity>
>>>>>>>>     </document>
>>>>>>>> </dataConfig>
>>>>>>>>
>>>>>>>> I am using the 1.3 release version, with the 1.4 DIH jar
file for
>>>>>>>> the
>>>>>>>> Clob
>>>>>>>> Transformer. What could be causing this?
>>>>>>>>
>>>>>>>> Cheers
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> View this message in context:
>>>>>>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23728596.html
>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> -----------------------------------------------------
>>>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23741712.html
>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> -----------------------------------------------------
>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23742423.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> -----------------------------------------------------
>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23742835.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>



-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com

Mime
View raw message