Return-Path: Delivered-To: apmail-lucene-solr-user-archive@minotaur.apache.org Received: (qmail 63810 invoked from network); 3 Apr 2009 19:29:02 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 3 Apr 2009 19:29:02 -0000 Received: (qmail 54167 invoked by uid 500); 3 Apr 2009 19:29:00 -0000 Delivered-To: apmail-lucene-solr-user-archive@lucene.apache.org Received: (qmail 54078 invoked by uid 500); 3 Apr 2009 19:29:00 -0000 Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: solr-user@lucene.apache.org Delivered-To: mailing list solr-user@lucene.apache.org Received: (qmail 54068 invoked by uid 99); 3 Apr 2009 19:29:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 19:29:00 +0000 X-ASF-Spam-Status: No, hits=2.6 required=10.0 tests=DNS_FROM_OPENWHOIS,SPF_HELO_PASS,SPF_PASS,WHOIS_MYPRIVREG X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lists@nabble.com designates 216.139.236.158 as permitted sender) Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 03 Apr 2009 19:28:52 +0000 Received: from isper.nabble.com ([192.168.236.156]) by kuber.nabble.com with esmtp (Exim 4.63) (envelope-from ) id 1Lpp43-0001ze-8e for solr-user@lucene.apache.org; Fri, 03 Apr 2009 12:28:31 -0700 Message-ID: <22874217.post@talk.nabble.com> Date: Fri, 3 Apr 2009 12:28:31 -0700 (PDT) From: ashokc To: solr-user@lucene.apache.org Subject: Re: Oracle Clob column with DIH does not turn to String In-Reply-To: <5e76b0ad0904031016y355678c7q6204c64e52bef276@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Nabble-From: ashokc@qualcomm.com References: <22859837.post@talk.nabble.com> <22859865.post@talk.nabble.com> <5e76b0ad0904022031w107077b8g4b1effbff25eb785@mail.gmail.com> <22861630.post@talk.nabble.com> <5e76b0ad0904022201g6431d52cy5a5bcece01790bbe@mail.gmail.com> <22867161.post@talk.nabble.com> <5e76b0ad0904030927x23b392bema986b4d9e15735f0@mail.gmail.com> <22872184.post@talk.nabble.com> <5e76b0ad0904030946v5b258aafv1fa9bf0bbde3b816@mail.gmail.com> <22872440.post@talk.nabble.com> <5e76b0ad0904031016y355678c7q6204c64e52bef276@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org Happy to report that it is working. Looks like we have to use UPPER CASE fo= r all the column names. When I examined the map 'aRow', it had the column names in upper case, where as my config had lower case. No match was found so nothing happened. Changed my config and it works now. Thanks for your help. Perhaps this transformer can be modified to be case-insensitive for the column names. If you had written it perhaps it is a quick change for you?=20 Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D=E2=80=8D = =E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrote: >=20 > I guess u can write a custom transformer which gets a String out of > the oracle.sql.CLOB. I am just out of clue, why this may happen. I > even wrote a testcase and it seems to work fine > --Noble >=20 > On Fri, Apr 3, 2009 at 10:23 PM, ashokc wrote: >> >> I downloaded the nightly build yesterday (2nd April), modified the >> ClobTransformer.java file with some prints, compiled it all (ant dist). >> It >> produced a war file, "apache-solr-1.4-dev.war". That is what I am using. >> My >> modification & compilation has not affected the results. I was getting >> the >> same behavior with the 'war' that download came with. Thanks Noble. >> >> Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D=E2=80= =8D =C2=A0=E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrote: >>> >>> and which version of Solr are u using? >>> >>> On Fri, Apr 3, 2009 at 10:09 PM, ashokc wrote: >>>> >>>> Sure: >>>> >>>> data-config Xml >>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>> >>>> >>>> =C2=A0 =C2=A0>>> url=3D"jdbc:oracle:thin:@xxxxx" user=3D"remedy" password=3D"yyyyy"/> >>>> =C2=A0 =C2=A0 >>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0>>> query=3D"SELECT >>>> mylog_ato, name_char, dsc FROM log_tbl"> >>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 >>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 >>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 >>>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 >>>> =C2=A0 =C2=A0 >>>> >>>> >>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>> >>>> A search result on the field short_desc: >>>> -------------------------------------- >>>> >>>> >>>> 1.8670129 >>>> oracle.sql.CLOB@155e3ab >>>> 4486 >>>> Develop Rating functionality for QIN >>>> 2009-04-03T11:47:32.635Z >>>> >>>> >>>> >>>> >>>> >>>> Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D=E2= =80=8D =C2=A0=E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrote: >>>>> >>>>> There is something else wrong with your setup. >>>>> >>>>> can you just paste the whole data-config.xml >>>>> >>>>> --Noble >>>>> >>>>> On Fri, Apr 3, 2009 at 5:39 PM, ashokc wrote: >>>>>> >>>>>> Noble, >>>>>> I put in a few 'System.out.println' statements in the >>>>>> ClobTransformer.java >>>>>> file & remade the war. But I see none of these prints coming up in m= y >>>>>> 'catalina.out' file. Is that the right file to be looking at? >>>>>> >>>>>> As an aside, is 'catalina.out' the ONLY log file for SOLR? I turned >>>>>> on >>>>>> the >>>>>> logging to 'FINE' for everything. Also, these settings seem to go >>>>>> away >>>>>> when >>>>>> Tomcat is restarted. >>>>>> - ashok >>>>>> >>>>>> Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D=E2= =80=8D =C2=A0=E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrote: >>>>>>> >>>>>>> yeah, ant dist will give you the .war file you may need . just drop >>>>>>> it >>>>>>> in and you are set to go. or if you can hook up a debugger to a >>>>>>> running Solr that is the easiest >>>>>>> --Noble >>>>>>> >>>>>>> On Fri, Apr 3, 2009 at 9:35 AM, ashokc wrote: >>>>>>>> >>>>>>>> That would require me to recompile (with ant/maven scripts?) the >>>>>>>> source >>>>>>>> and >>>>>>>> replace the jar for DIH, right? I can try - for the first time. >>>>>>>> - ashok >>>>>>>> >>>>>>>> Noble Paul =E0=B4=A8=E0=B5=8B=E0=B4=AC=E0=B4=BF=E0=B4=B3=E0=B5=8D= =E2=80=8D =C2=A0=E0=A4=A8=E0=A5=8B=E0=A4=AC=E0=A5=8D=E0=A4=B3=E0=A5=8D wrot= e: >>>>>>>>> >>>>>>>>> This looks strange. Apparently the Transformer did not get >>>>>>>>> applied. >>>>>>>>> Is >>>>>>>>> it possible for you to debug ClobTransformer >>>>>>>>> adding(System.out.println >>>>>>>>> into ClobTransformer may help) >>>>>>>>> >>>>>>>>> On Fri, Apr 3, 2009 at 6:04 AM, ashokc >>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> Correcting my earlier post. It lost some lines some how. >>>>>>>>>> >>>>>>>>>> Hi, >>>>>>>>>> >>>>>>>>>> I have set up to import some oracle clob columns with DIH. I am >>>>>>>>>> using >>>>>>>>>> the >>>>>>>>>> latest nightly release. My config says, >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>> ... >>>>>>>>>> >>>>>>>>>> =C2=A0 =C2=A0 >>>>>>>>>> =C2=A0 =C2=A0.... >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> But it does not seem to turn this clob into a String. The search >>>>>>>>>> results >>>>>>>>>> show: >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> =C2=A0 1.8670129 >>>>>>>>>> =C2=A0 =C2=A0oracle.sql.CLOB@aed3a5 >>>>>>>>>> =C2=A0 4486 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> Any pointers on why I do not get the 'string' out of the clob fo= r >>>>>>>>>> indexing? >>>>>>>>>> Is the nightly war NOT the right one to use? >>>>>>>>>> >>>>>>>>>> Thanks for your help. >>>>>>>>>> >>>>>>>>>> - ashok >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> ashokc wrote: >>>>>>>>>>> >>>>>>>>>>> Hi, >>>>>>>>>>> >>>>>>>>>>> I have set up to import some oracle clob columns with DIH. I am >>>>>>>>>>> using >>>>>>>>>>> the >>>>>>>>>>> latest nightly release. My config says, >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> column=3D"description" clob=3D"true" /> >>>>>>>>>>> =C2=A0 =C2=A0 .... >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> But it does not seem to turn this clob into a String. The searc= h >>>>>>>>>>> results >>>>>>>>>>> show: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> =C2=A0 =C2=A01.8670129 >>>>>>>>>>> =C2=A0 =C2=A0 oracle.sql.CLOB@aed3a5<= /str> >>>>>>>>>>> =C2=A0 =C2=A04486 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Any pointers on why I do not get the 'string' out of the clob >>>>>>>>>>> for >>>>>>>>>>> indexing? Is the nightly war NOT the right one to use? >>>>>>>>>>> >>>>>>>>>>> Thanks for your help. >>>>>>>>>>> >>>>>>>>>>> - ashok >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> View this message in context: >>>>>>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-= to-String-tp22859837p22859865.html >>>>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> --Noble Paul >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> View this message in context: >>>>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to= -String-tp22859837p22861630.html >>>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> --Noble Paul >>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: >>>>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-S= tring-tp22859837p22867161.html >>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> --Noble Paul >>>>> >>>>> >>>> >>>> -- >>>> View this message in context: >>>> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-Str= ing-tp22859837p22872184.html >>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>> >>>> >>> >>> >>> >>> -- >>> --Noble Paul >>> >>> >> >> -- >> View this message in context: >> http://www.nabble.com/Oracle-Clob-column-with-DIH-does-not-turn-to-Strin= g-tp22859837p22872440.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> >=20 >=20 >=20 > --=20 > --Noble Paul >=20 >=20 --=20 View this message in context: http://www.nabble.com/Oracle-Clob-column-with= -DIH-does-not-turn-to-String-tp22859837p22874217.html Sent from the Solr - User mailing list archive at Nabble.com.