Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
Received-SPF: pass (athena.apache.org: domain of solr@elyograg.org designates
 166.70.79.219 as permitted sender)
Message-ID: <504A6B36.4040304@elyograg.org>
Date: Fri, 07 Sep 2012 15:46:30 -0600
From: Shawn Heisey <solr@elyograg.org>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64;
 rv:15.0) Gecko/20120824 Thunderbird/15.0
MIME-Version: 1.0
To: solr-user@lucene.apache.org
Subject: Re: Importing of unix date format from mysql database and dates of
 format 'Thu, 06 Sep 2012 22:32:33 +0000' in Solr 4.0
References: 
 <CAPp-OAu2U6YQQiv9zccskorv5rnYZQ1oYQrcBWv=dOFcF_NPQg@mail.gmail.com>
 <alpine.DEB.2.02.1209061725310.17122@frisbee>
 <CAPp-OAurS_U5oVS86ekA2kdWjmZBhnG07K6B=togCk5h-N5dqQ@mail.gmail.com>
In-Reply-To: 
 <CAPp-OAurS_U5oVS86ekA2kdWjmZBhnG07K6B=togCk5h-N5dqQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

On 9/6/2012 6:54 PM, kiran chitturi wrote:
> The error i am getting is 'org.apache.solr.common.SolrException: Invalid
> Date String: '1345743552'.
>
>   I think it was being saved as a string in DB, so i will use the
> DateFormatTransformer.

To go along with all the other replies that you have gotten:  I import 
from MySQL with a unix format date field.  It's a bigint, not a string, 
but a quick test on MySQL 5.1 shows that the function works with strings 
too.  This is how my SELECT handles that field - I have MySQL convert it 
before it gets to Solr:

from_unixtime(`d`.`post_date`) AS `pd`

When it comes to the character set issues, this is how I have defined 
the driver in the dataimport config.  The character set in the database 
is utf8.

   <dataSource type="JdbcDataSource"
     driver="com.mysql.jdbc.Driver"
     encoding="UTF-8"
url="jdbc:mysql://${dataimporter.request.dbHost}:3306/${dataimporter.request.dbSchema}?zeroDateTimeBehavior=convertToNull"
     batchSize="-1"
     user="<removed>"
     password="<removed>"/>

Thanks,
Shawn