lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Noble Paul നോബിള്‍ नोब्ळ्" <noble.p...@gmail.com>
Subject Re: Solr indexing not taking all values from DB.
Date Sun, 12 Oct 2008 06:23:12 GMT
template transformer does not eat up rows.

I am almost sure that the query returns only 10 rows in that case.
could you write a quick jdbc program and verify that (not the oralce
client)

everything else looks fine

On Sat, Oct 11, 2008 at 4:52 PM, con <convoyer@gmail.com> wrote:
>
> Hi Noble
> Thanks for your reply
>
> In my data-config.xml I have;
>
>        <entity name="employees" transformer="TemplateTransformer"  query="Select
> EMP_ID , EMP_NAME , NVL (COMMENT ,'-Nil-') as COMMENT  from EMPLOYEES">
>                <field column="rowtype" template="employees" />
>                <field column="EMP_ID" name="EMP_ID" />
>                <field column="EMP_NAME" name="EMP_NAME" />
>                <field column="COMMENT" name="COMMENT" />
>        </entity>
>
>        <entity name="customers" transformer="TemplateTransformer"  query="Select
> CUST_ID , CUST_NAME , NVL (COMMENT ,'-Nil-') as COMMENT  from CUSTOMERS">
>                <field column="rowtype" template="customers" />
>                <field column="CUST_ID" name="CUST_ID />
>                <field column="CUST_NAME" name="CUST_NAME" />
>                <field column="COMMENT" name="COMMENT" />
>        </entity>
>
> Whether this, TemplateTransformer, is the one that is restricting the
> resultset count to 10?
> Where can I find it out?
> I need this TemplateTransformer because I want to query the responses of
> either one of these at a time using the URL like,
>
> http://localhost:8983/solr/select/?q=(Bob%20AND%20rowtype:customers)&version=2.2&start=0&rows=10&indent=on&wt=json
>
> I tried in the debug mode:
> (http://localhost:8983/solr/dataimport?command=full-import&debug=on&verbose=on)
> , But it is not all mentioning anything after the 10th document.
>
>
> Thanks and regards
> con
>
>
>
> Noble Paul നോബിള്‍ नोब्ळ् wrote:
>>
>> The DIH status says 10 rows which means only 10 rows got fetched for
>> that query. Do you have any custom transformers which eats up rows?
>>
>> Try the debug page of DIH and see what is happening to the rest of the
>> rows.
>>
>>
>>
>> On Fri, Oct 10, 2008 at 5:32 PM, con <convoyer@gmail.com> wrote:
>>>
>>> A simple question:
>>> I performed the following steps to index data from a oracle db to solr
>>> index
>>> and then search:
>>> a) I have the configurations for indexing data from a oracle db
>>> b) started the server.
>>> c) Done a full-import:
>>> http://localhost:8983/solr/dataimport?command=full-import
>>>
>>> But when I do a search using http://localhost:8983/solr/select/?q=....
>>> Not all the result sets that matches the search string are displayed.
>>>
>>> 1) Is the above steps enough for getting db values to solr index?
>>> My configurations (data-config.xml and schema.xml )are quite correct
>>> because
>>> I am getting SOME of the result sets as search result(not all).
>>> 2) Is there some value in sorconfig.xml, or some other files that limits
>>> the
>>> number of items being indexed? [For the time being I have only a few
>>> hundreds of records in my db. ]
>>> The query that I am specifying in data-config yields around 25 results if
>>> i
>>> execute it in a oracle client, where as the status of full-import is
>>> something like:
>>> <str name="status">idle</str>
>>> <str name="importResponse">Configuration Re-loaded sucessfully</str>
>>> <lst name="statusMessages">
>>>        <str name="Total Requests made to DataSource">1</str>
>>>        <str name="Total Rows Fetched">10</str>
>>>        <str name="Total Documents Skipped">0</str>
>>>        <str name="Full Dump Started">2008-10-10 17:29:03</str>
>>>        <str name="Time taken ">0:0:0.513</str>
>>> </lst>
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Solr-indexing-not-taking-all-values-from-DB.-tp19916938p19916938.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>>
>> --
>> --Noble Paul
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Solr-indexing-not-taking-all-values-from-DB.-tp19916938p19931736.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>



-- 
--Noble Paul
Mime
View raw message