lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Earle <erikea...@yahoo.com>
Subject Re: DataImportHandler ignoring most rows
Date Wed, 19 Aug 2009 00:03:48 GMT
Upgraded to the tip from svn and still no love.



----- Original Message ----
From: Erik Earle <erikearle@yahoo.com>
To: solr-user@lucene.apache.org
Sent: Tuesday, August 18, 2009 3:16:47 PM
Subject: DataImportHandler ignoring most rows

Using:
- apache-solr-1.3.0
- java 1.6 
- tomcat 6
- sql server 2005 w/ JSQLConnect 4.0 driver

I have a group table with 3007 rows.  I have confirmed the key is
unique with "select distinct id from group"  and it returns 3007.  When i re-index using http://host:port/solr/dataimport?command=full-import
 I only get 7 records indexed.  Any insight into what is going on would be really great. 


A partial response:
    <lst name="statusMessages">
    <str name="Total Requests made to DataSource">1</str>
    <str name="Total Rows Fetched">7</str>
    <str name="Total Documents Skipped">0</str>


I have other entities that index all the rows without issue.

There are no errors in the logs.

I am not using any Transformers (and most of my config is not changed from install)

My schema.xml contains:

     <uniqueKey>key</uniqueKey>

and field defs (not a full list of fields):
   <field name="key" type="string" indexed="true" stored="true" required="true" /> 
   <field name="class" type="string" indexed="true" stored="true" required="true" />
   <field name="id" type="string" indexed="true" stored="true" /> 
   <field name="description" type="text" indexed="true" stored="true" />
   <field name="created" type="date" indexed="true" stored="true" />
   <field name="updated" type="date" indexed="true" stored="true" />

data-config.xml
################
<dataConfig>
    <!-- jdbc:JSQLConnect://se-eriearle-lt1/database=SocialSite2/user=SocialSite2/logfile=DB_TRACE.log
-->
    <dataSource type="JdbcDataSource" 
        driver="com.jnetdirect.jsql.JSQLDriver"
        url="jdbc:JSQLConnect://se-eriearle-lt1/database=SocialSite2/user=SocialSite2" 
        user="SocialSite2" 
        password="SocialSite2" />

    <document>
      
    ....

        <entity name="Group"  pk="key"
            query="select 'group.'+id as 'key', 'group' as 'class', name, handle, description,
created, updated from group order by created asc">
        </entity>

        <entity name="Message" pk="key"
            query="<...redacted...>">
        </entity>
  
    </document>
</dataConfig>


      

Mime
View raw message