lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ahammad <ahmed.ham...@gmail.com>
Subject Re: Indexing from DB connection issue
Date Wed, 27 May 2009 13:45:12 GMT

Hello,

I tried your suggestion, and it still gives me the same error.

I'd like to point out again that the same folder/config setup is running on
my machine with no issues, but it gives me that stack trace in the logs on
the server.

When I do the full data import request through the browser, I get this:

<response>
−
<lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">0</int>
</lst>
−
<lst name="initArgs">
−
<lst name="defaults">
<str name="config">data-config.xml</str>
</lst>
</lst>
<str name="command">full-import</str>
<str name="status">idle</str>
<str name="importResponse"/>
−
<lst name="statusMessages">
<str name="Time Elapsed">0:0:1.329</str>
<str name="Total Requests made to DataSource">1</str>
<str name="Total Rows Fetched">0</str>
<str name="Total Documents Processed">0</str>
<str name="Total Documents Skipped">0</str>
<str name="Full Dump Started">2009-05-27 09:42:24</str>
</lst>
−
<str name="WARNING">
This response format is experimental.  It is likely to change in the future.
</str>
</response>


Refreshing the page usually results in requests to datasource/rows fetched
etc numbers to increase. In my case the request to datasource stays at 1
regardless. Looks like it tries once and fails, then it terminates the
process...

Regards


Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
> 
> no need to rename .
> 
> On Wed, May 27, 2009 at 6:50 PM, ahammad <ahmed.hammad@gmail.com> wrote:
>>
>> Would I need to rename it or refer to it somewhere? Or can I keep the
>> existing name (apache-solr-dataimporthandler-1.4-dev.jar)?
>>
>> Cheers
>>
>>
>> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>>>
>>> take the trunk dih.jar. use  winzip/winrar or any tool and just delete
>>> all the files other than ClobTransformer.class. put that jar into
>>> solr.home/lib
>>>
>>> On Wed, May 27, 2009 at 6:10 PM, ahammad <ahmed.hammad@gmail.com> wrote:
>>>>
>>>> Hmmm, that's probably a good idea...although it does not explain how my
>>>> current local setup works.
>>>>
>>>> Can you please explain how this is done? I am assuming that I need to
>>>> add
>>>> the class itself to the source of solr 1.3, and then compile the code,
>>>> and
>>>> take the new .war file and put it in Tomcat? If that is correct, where
>>>> in
>>>> the source folders would the ClobTransformer.class file go?
>>>>
>>>> Thanks.
>>>>
>>>>
>>>>
>>>> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>>>>>
>>>>> I guess it is better to copy the ClobTransformer.class  alone and use
>>>>> the old Solr1.3 DIH
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, May 26, 2009 at 11:50 PM, ahammad <ahmed.hammad@gmail.com>
>>>>> wrote:
>>>>>>
>>>>>> I have an update:
>>>>>>
>>>>>> I played around with it some more and it seems like it's being caused
>>>>>> by
>>>>>> the
>>>>>> ClobTransformer. If I remove the 'clob="true"' from the field part
in
>>>>>> the
>>>>>> data-config, it works fine.
>>>>>>
>>>>>> The Solr install is a multicore one. I placed the
>>>>>> apache-solr-dataimporthandler-1.4-dev.jar from the nightly builds
in
>>>>>> the
>>>>>> {solrHome}/core1/lib directory (I only need it for the first core).
>>>>>> Is
>>>>>> there
>>>>>> something else I need to do for it to work?
>>>>>>
>>>>>> I don't recall doing an additional step when I did this a few weeks
>>>>>> ago
>>>>>> on
>>>>>> my local machine.
>>>>>>
>>>>>> Any help is appreciated.
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>>
>>>>>> ahammad wrote:
>>>>>>>
>>>>>>> Hello all,
>>>>>>>
>>>>>>> I am tyring to index directly from an Oracle DB. This is what
>>>>>>> appears
>>>>>>> in
>>>>>>> the stack trace:
>>>>>>>
>>>>>>> SEVERE: Full Import failed
>>>>>>> org.apache.solr.handler.dataimport.DataImportHandlerException:
>>>>>>> Unable
>>>>>>> to
>>>>>>> execute query: select * from ARTICLE Processing Document # 1
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:186)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:143)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:43)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:74)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:285)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:178)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:136)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:334)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:386)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:377)
>>>>>>> Caused by: java.sql.SQLException: Closed Connection
>>>>>>>       at
>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)
>>>>>>>       at
>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146)
>>>>>>>       at
>>>>>>> oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:208)
>>>>>>>       at
>>>>>>> oracle.jdbc.driver.PhysicalConnection.createStatement(PhysicalConnection.java:755)
>>>>>>>       at
>>>>>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:174)
>>>>>>>       ... 10 more
>>>>>>>
>>>>>>> Funny thing is, the data import works on my local machine. I
moved
>>>>>>> all
>>>>>>> the
>>>>>>> config files to another server, and I get this. I reindexed on
my
>>>>>>> local
>>>>>>> machine immediately after in order to verify that the DB works,
and
>>>>>>> it
>>>>>>> indexes fine.
>>>>>>>
>>>>>>> Here is my data-config file, just in case:
>>>>>>>
>>>>>>> <dataConfig>
>>>>>>>     <dataSource driver="oracle.jdbc.driver.OracleDriver"
>>>>>>> url="xxxxxxx"
>>>>>>> user="xxxxxxx" password="xxxxxxx"/>
>>>>>>>     <document name="articles">
>>>>>>>             <entity name="ARTICLE" pk="ID" query="select
* from
>>>>>>> ARTICLE"
>>>>>>> transformer="ClobTransformer">
>>>>>>>                               <field column="TITLE"
name="title" />
>>>>>>>                               <field column="BODY"
name="body"
>>>>>>> clob="true" />
>>>>>>>                               <field column="ID"
name="id" />
>>>>>>>
>>>>>>>                               <entity name="ARTICLE_AUTHOR"
>>>>>>> query="select ID_A from ARTICLE_AUTHOR
>>>>>>> where ID_A='${ARTICLE.ID}'">
>>>>>>>                                        <field
column="ID_A"
>>>>>>> name="author"  />
>>>>>>>                               </entity>
>>>>>>>
>>>>>>>         </entity>
>>>>>>>     </document>
>>>>>>> </dataConfig>
>>>>>>>
>>>>>>> I am using the 1.3 release version, with the 1.4 DIH jar file
for
>>>>>>> the
>>>>>>> Clob
>>>>>>> Transformer. What could be causing this?
>>>>>>>
>>>>>>> Cheers
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> View this message in context:
>>>>>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23728596.html
>>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> -----------------------------------------------------
>>>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>>>
>>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23741712.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> -----------------------------------------------------
>>> Noble Paul | Principal Engineer| AOL | http://aol.com
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23742423.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
> 
> 
> 
> -- 
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
> 
> 

-- 
View this message in context: http://www.nabble.com/Indexing-from-DB-connection-issue-tp23725712p23742835.html
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message