lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Earle <>
Subject Re: DataImportHandler ignoring most rows
Date Wed, 19 Aug 2009 00:03:48 GMT
Upgraded to the tip from svn and still no love.

----- Original Message ----
From: Erik Earle <>
Sent: Tuesday, August 18, 2009 3:16:47 PM
Subject: DataImportHandler ignoring most rows

- apache-solr-1.3.0
- java 1.6 
- tomcat 6
- sql server 2005 w/ JSQLConnect 4.0 driver

I have a group table with 3007 rows.  I have confirmed the key is
unique with "select distinct id from group"  and it returns 3007.  When i re-index using http://host:port/solr/dataimport?command=full-import
 I only get 7 records indexed.  Any insight into what is going on would be really great. 

A partial response:
    <lst name="statusMessages">
    <str name="Total Requests made to DataSource">1</str>
    <str name="Total Rows Fetched">7</str>
    <str name="Total Documents Skipped">0</str>

I have other entities that index all the rows without issue.

There are no errors in the logs.

I am not using any Transformers (and most of my config is not changed from install)

My schema.xml contains:


and field defs (not a full list of fields):
   <field name="key" type="string" indexed="true" stored="true" required="true" /> 
   <field name="class" type="string" indexed="true" stored="true" required="true" />
   <field name="id" type="string" indexed="true" stored="true" /> 
   <field name="description" type="text" indexed="true" stored="true" />
   <field name="created" type="date" indexed="true" stored="true" />
   <field name="updated" type="date" indexed="true" stored="true" />

    <!-- jdbc:JSQLConnect://se-eriearle-lt1/database=SocialSite2/user=SocialSite2/logfile=DB_TRACE.log
    <dataSource type="JdbcDataSource" 
        password="SocialSite2" />


        <entity name="Group"  pk="key"
            query="select 'group.'+id as 'key', 'group' as 'class', name, handle, description,
created, updated from group order by created asc">

        <entity name="Message" pk="key"


View raw message