Return-Path: 
 <solr-user-return-49170-apmail-lucene-solr-user-archive=lucene.apache.org@lucene.apache.org>
Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org
Received: (qmail 40222 invoked from network); 22 Mar 2011 16:08:44 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 22 Mar 2011 16:08:44 -0000
Received: (qmail 95818 invoked by uid 500); 22 Mar 2011 16:08:41 -0000
Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org
Received: (qmail 95752 invoked by uid 500); 22 Mar 2011 16:08:41 -0000
Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:solr-user-help@lucene.apache.org>
List-Unsubscribe: <mailto:solr-user-unsubscribe@lucene.apache.org>
List-Post: <mailto:solr-user@lucene.apache.org>
List-Id: <solr-user.lucene.apache.org>
Reply-To: solr-user@lucene.apache.org
Delivered-To: mailing list solr-user@lucene.apache.org
Received: (qmail 95744 invoked by uid 99); 22 Mar 2011 16:08:41 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2011 16:08:41 +0000
X-ASF-Spam-Status: No, hits=4.0 required=5.0
	tests=FREEMAIL_FROM,FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of matiasgalonso@gmail.com
 designates 209.85.160.176 as permitted sender)
Received: from [209.85.160.176] (HELO mail-gy0-f176.google.com)
 (209.85.160.176)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2011 16:08:35 +0000
Received: by gyd12 with SMTP id 12so3074147gyd.35
        for <solr-user@lucene.apache.org>;
 Tue, 22 Mar 2011 09:08:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=domainkey-signature:mime-version:in-reply-to:references:date
         :message-id:subject:from:to:cc:content-type;
        bh=9uPqCwBRGcDzYLej9qh+kRb5BfwE7Q+AVjqKMSbO2cM=;
        b=NDZ3xEmzChF0zsA/4FC8erin3cW6VNAjqp92JM6A1BYZogk+jsXdlyfindU37AEcYe
         2ix9SqYzpf7eUYlCNjHHuZAjGoMwe8+/dqIfe9Qa3YwTGj6eLuLG3KKSXZlx/TrB9Lyh
         LxYtcvO8QnFRDWjr38JvppIJytU4VXmHVf9i0=
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :cc:content-type;
        b=OacCLsyKvXmz/Uh1egY6F+qiLFFBW+umOF2ED4d1NECLMclfwe6JO1BNBfmIJ/qZrk
         VZlWMFji18j2aYtLWZKbZNHKpRQ3UTsZ4ZNFI0zu56ZHGznMBr+n8go1ke0CF0tqUwaZ
         RrnUQ58evWWUZnB2YXc47JF9/pxcPK4aPjjxY=
MIME-Version: 1.0
Received: by 10.52.95.135 with SMTP id dk7mr5835808vdb.93.1300810094368; Tue,
 22 Mar 2011 09:08:14 -0700 (PDT)
Received: by 10.220.204.69 with HTTP; Tue, 22 Mar 2011 09:08:14 -0700 (PDT)
In-Reply-To: <AANLkTimcywOyoQaYNNqLHdt2rdbTYeRT_nwURrvJaSzk@mail.gmail.com>
References: <AANLkTi=747k5sDahz_7c3ZBg+nwjb8bD+6HjE6G4wuG-@mail.gmail.com>
	<AANLkTimcywOyoQaYNNqLHdt2rdbTYeRT_nwURrvJaSzk@mail.gmail.com>
Date: Tue, 22 Mar 2011 13:08:14 -0300
Message-ID: <AANLkTimEymqW+Kh_XATuE2OaGjHThVAN7WUC5othEaqg@mail.gmail.com>
Subject: Re: email - DIH
From: Matias Alonso <matiasgalonso@gmail.com>
To: solr-user@lucene.apache.org
Cc: Erick Erickson <erickerickson@gmail.com>
Content-Type: multipart/alternative; boundary=20cf307cfe9e9859e2049f1473e9

--20cf307cfe9e9859e2049f1473e9
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Thank you very much for your answer Erick.


My apologies for the previous email; my problem is that I don=B4t speak
English very well and I=B4m new in the world of mailing list.


The problem is that I=B4m indexing emails throw Data import Handler using
Gmail with imaps; I do this for search on email list in the future. The
emails are indexed partiality and I can=B4t found the problem of why don=B4=
t
index all of the emails.



Below I show you de configuration of my DIH.


<dataConfig>

                <document>

                               <entity

                                               name=3D"gmail"


processor=3D"MailEntityProcessor"

                                               transformer=3D"LogTransforme=
r"

                                               user=3D"email@gmail.com"

                                               password=3D"password"

                                               host=3D"imap.gmail.com"

                                               protocol=3D"imaps"

                                               fetchMailsSince=3D"2010-01-0=
1
00:00:00"

                                               folders=3D"inbox"

                                               deltaFetch=3D"false"

                                               processAttachement=3D"false"

                                               batchSize=3D"100"

                                               fetchSize=3D"1024"

                                               recurse=3D"true" />

                </document>

</dataConfig>



The date of my emails is later to =932010-01-01 00:00:00=94.




I=B4ve done a full import and no errors were found, but in the status I saw
that was added 28 documents, and in the console, I found 35 messanges.

Below I show you the status screen, first, and then part of the console
output.



Status:

<response>

<lst name=3D"responseHeader">

<int name=3D"status">0</int>

<int name=3D"QTime">1</int>

</lst>

<lst name=3D"initArgs">

<lst name=3D"defaults">

<str name=3D"config">data-config.xml</str>

</lst>

</lst>

<str name=3D"command">status</str>

<str name=3D"status">idle</str>

<str name=3D"importResponse"/>

<lst name=3D"statusMessages">

<str name=3D"Total Requests made to DataSource">0</str>

<str name=3D"Total Rows Fetched">28</str>

<str name=3D"Total Documents Skipped">0</str>

<str name=3D"Full Dump Started">2011-03-22 15:55:12</str>

<str name=3D"">

Indexing completed. Added/Updated: 28 documents. Deleted 0 documents.

</str>

<str name=3D"Committed">2011-03-22 15:55:20</str>

<str name=3D"Optimized">2011-03-22 15:55:20</str>

<str name=3D"Total Documents Processed">28</str>

<str name=3D"Time taken ">0:0:8.520</str>

</lst>

<str name=3D"WARNING">

This response format is experimental.  It is likely to change in the future=
.

</str>

</response>



=85=94

Mar 22, 2011 3:55:14 PM
org.apache.solr.handler.dataimport.MailEntityProcessor connectToMailBox

INFO: Connected to mailbox

Mar 22, 2011 3:55:15 PM
org.apache.solr.handler.dataimport.MailEntityProcessor$FolderIterator next

INFO: Opened folder : inbox

Mar 22, 2011 3:55:15 PM
org.apache.solr.handler.dataimport.MailEntityProcessor$FolderIterator next

INFO: Added its children to list  :

Mar 22, 2011 3:55:15 PM
org.apache.solr.handler.dataimport.MailEntityProcessor$FolderIterator next

INFO: NO children :

Mar 22, 2011 3:55:16 PM
org.apache.solr.handler.dataimport.MailEntityProcessor$MessageIterator
<init>

INFO: Total messages : 35

Mar 22, 2011 3:55:16 PM
org.apache.solr.handler.dataimport.MailEntityProcessor$MessageIterator
<init>

INFO: Search criteria applied. Batching disabled

Mar 22, 2011 3:55:19 PM org.apache.solr.handler.dataimport.DocBuilder finis=
h

INFO: Import completed successfully

=93=85



Regards,

Matias.





2011/3/22 Erick Erickson <erickerickson@gmail.com>

> Not unless you provide a lot more data. Have you
> inspected the Solr logs and seen any anomalies?
>
> Please review:
> http://wiki.apache.org/solr/UsingMailingLists
>
> Best
> Erick
>
> On Mon, Mar 21, 2011 at 3:56 PM, Matias Alonso <matiasgalonso@gmail.com>
> wrote:
> > Hi,
> >
> >
> > I=92m using Data Import Handler for index emails.
> >
> > The problem is that nota ll the emails was indexed When I do a full
> import.
> >
> > Someone have any idea?
> >
> >
> > Regards,
> >
> > --
> > Matias.
> >
>

--20cf307cfe9e9859e2049f1473e9--