I have a Lucene index that is very large in size. It was created using a pre 2.1 version of Lucene.net 2.0.0.4. The index is currently almost 20 GB, and has almost 7000 segment files. The problem I am having is that I need to optimize it, and cant do this without the search functionality of my app being down for a week. I used the Luke tool from getopt.org and it worked flawlessly, optimizing the index in just over 2 hours. Problem is that my search cannot use it, and the error states Unknown Format Version errors, or just plain nothing found. I understand that versions of Lucene that are newer than what the index was built and is searched with can cause problems. What can I do to make this work? I have tried older versions of Luke, 0.7 was the oldest I could lay hands on, but even it uses a newer version of Lucene. My index version shows as 633103800023469045. The version the index is written as after optimizing with Luke 7.0 is 633103800023469057. Any help here would be awesome! Thank you, Hugh -- View this message in context: http://www.nabble.com/Optimization-and-Corruption-Issues-tp25696990p25696990.html Sent from the Lucene - C Developer mailing list archive at Nabble.com.
Hello friend i need your help,
How to write the Sql in query in Lucene.
Example
Sql Query:
String tagIdStr="x,y,z";
List results=fSession.createQuery("from com.test.x.manager.TagTest where id
in ("+tagIdStr+")").list();
I have tried to write this query in Lucene but the list result is showing 0.
Lucene Query:
List results =fSession.createFullTextQuery(new WildcardQuery(new
Term("id","*"+tagIdStr+"*" )), TagTest.class).list();
Please suggested me how i can implemented this.
Thanks in Advance
Gopal Bisht
--
View this message in context: http://www.nabble.com/How-to-write-the-Sql-in%28intersection%29-query-in-Lucene.-tp23403965p23403965.html
Sent from the Lucene - C Developer mailing list archive at Nabble.com.
Hello ALL, I am new to Clucene. Clucene store the index info of documents in files rather than a database. So, I wonder if the index files support simmultaneous accesses from multiple queries occurring at the same time. Thanks Felix -- View this message in context: http://www.nabble.com/is-the-index-file-support-simultaneous-query-accesses-tp21156872p21156872.html Sent from the Lucene - C Developer mailing list archive at Nabble.com.
We want to be able to apply a date-score criteria within Lucene so that more-recent documents score higher. We also want to be able to apply some boost factor to this date-field score. Right now we use Lucense to score the documents based on search citeria and then apply our own "recency-of-date+bost factor factor" formula. We thus generate a combined score which we then use to display results that now incorporate the date criteria. But we prefer to do this completely within Lucene. Is there a way to do this? What is the best way? Which functiojn, field would we use? Thank you, Felix
On 10/9/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > Since there hasn't been any significant work on Lucene4c in quite some > time, I'd like to officially mark it as dormant so I don't have to > keep writing board reports that just say "there has been no progress > in the last 3 months". > > So, cast your votes now: > > [ ] +1 - Mark Lucene4c as dormant. > [ ] 0 - I have no opinion. > [ ] -1 - No, please keep it! [include reason] FYI, we had 8 +1 votes, and no objections, so I've begun the process of shutting the project down. -garrett
+1 -Yonik On 10/9/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > Since there hasn't been any significant work on Lucene4c in quite some > time, I'd like to officially mark it as dormant so I don't have to > keep writing board reports that just say "there has been no progress > in the last 3 months". > > So, cast your votes now: > > [ ] +1 - Mark Lucene4c as dormant. > [ ] 0 - I have no opinion. > [ ] -1 - No, please keep it! [include reason] > > -garrett
On 10/10/06, Leo Simons <mail@leosimons.com> wrote: > On Oct 9, 2006, at 5:34 PM, Garrett Rooney wrote: > > Since there hasn't been any significant work on Lucene4c in quite some > > time, I'd like to officially mark it as dormant so I don't have to > > keep writing board reports that just say "there has been no progress > > in the last 3 months". > > does "I" here means "lucene4c community"? > > > So, cast your votes now: > > > > [ ] +1 - Mark Lucene4c as dormant. > > [ ] 0 - I have no opinion. > > [ ] -1 - No, please keep it! [include reason] > > +1, assuming "the lucene4c people" (whoever that are) are happy with > this too. The "lucene4c people" basically means me, and Paul to some extent, although he never realy got around to doing anything ;-) -garrett
On Oct 9, 2006, at 5:34 PM, Garrett Rooney wrote: > Since there hasn't been any significant work on Lucene4c in quite some > time, I'd like to officially mark it as dormant so I don't have to > keep writing board reports that just say "there has been no progress > in the last 3 months". does "I" here means "lucene4c community"? > So, cast your votes now: > > [ ] +1 - Mark Lucene4c as dormant. > [ ] 0 - I have no opinion. > [ ] -1 - No, please keep it! [include reason] +1, assuming "the lucene4c people" (whoever that are) are happy with this too. LSD
On 10/9/06, Yoav Shapira <yoavs@apache.org> wrote: > Hi, > > On 10/9/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > > [ X ] +1 - Mark Lucene4c as dormant. > > [ ] 0 - I have no opinion. > > [ ] -1 - No, please keep it! [include reason] > > Will people have a post-ApacheCon todo / done list as well? I saw > this item on your preconference todo list ;) I was thinking of posting a "here's what I actually got done" list ;-) -garrett
Hi, On 10/9/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > [ X ] +1 - Mark Lucene4c as dormant. > [ ] 0 - I have no opinion. > [ ] -1 - No, please keep it! [include reason] Will people have a post-ApacheCon todo / done list as well? I saw this item on your preconference todo list ;) Yoav
On 10/9/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > Since there hasn't been any significant work on Lucene4c in quite some > time, I'd like to officially mark it as dormant so I don't have to > keep writing board reports that just say "there has been no progress > in the last 3 months". > > So, cast your votes now: > > [ ] +1 - Mark Lucene4c as dormant. > [ ] 0 - I have no opinion. > [ ] -1 - No, please keep it! [include reason] +1 from me, FWIW. -garrett
Since there hasn't been any significant work on Lucene4c in quite some time, I'd like to officially mark it as dormant so I don't have to keep writing board reports that just say "there has been no progress in the last 3 months". So, cast your votes now: [ ] +1 - Mark Lucene4c as dormant. [ ] 0 - I have no opinion. [ ] -1 - No, please keep it! [include reason] -garrett
hi Friends i would like to know that on what behalf Lucene defines "Relevance" in search results. if anyone worked on Relevance parameter from Lucene, then please do help me................. regards, Sudarshan
hi all i have some PDF files stored in Oracle 9i as BLOB. now i want to search for a string in those pdf files using Lucene. then i want to show the selected PDF files which contains The String. if you can give me any pointers about how to do it, then it will be a gr8 help for me. regards sudarshan
You may want to check this out as well: http://incubator.apache.org/solr/ On 6/29/06, Clive. <clive.lancaster@bestwestern.co.uk> wrote: > > > Thanks for that I have managed to fined Lucene4DB > http://www.netomatix.com/Products/DocumentManagement/Lucene4DB.aspx that > may > do the job. > -- > View this message in context: > http://www.nabble.com/Lucene-Dynamic-http-Web-Page-Search-tf1867982.html#a5105584 > Sent from the Lucene - C Developer forum at Nabble.com. > >
Thanks for that I have managed to fined Lucene4DB http://www.netomatix.com/Products/DocumentManagement/Lucene4DB.aspx that may do the job. -- View this message in context: http://www.nabble.com/Lucene-Dynamic-http-Web-Page-Search-tf1867982.html#a5105584 Sent from the Lucene - C Developer forum at Nabble.com.
Yes, I inject database files into a Lucene index every day using Cold Fusion. If it can be done with CF it can be done with .NET. On 6/29/06, Clive. <clive.lancaster@bestwestern.co.uk> wrote: > > > Hi, > > I am working on adding a search feature to a web site that uses single > database driven aspx pages and would like to know if Lucene can search > using > the http url address or database to index from. > As current I can only see Lucene being able to search physical files in a > windows folder. > > Any ideas? > > -- > View this message in context: > http://www.nabble.com/Lucene-Dynamic-http-Web-Page-Search-tf1867982.html#a5104440 > Sent from the Lucene - C Developer forum at Nabble.com. > >
On 6/29/06, Clive. <clive.lancaster@bestwestern.co.uk> wrote: > > Hi, > > I am working on adding a search feature to a web site that uses single > database driven aspx pages and would like to know if Lucene can search using > the http url address or database to index from. > As current I can only see Lucene being able to search physical files in a > windows folder. > This mail should probably be sent to a different lucene mailing list. This is a list associated with a (stalled) attempt to port Lucene to C. You probably want a general Lucene mailing list. -garrett
Hi, I am working on adding a search feature to a web site that uses single database driven aspx pages and would like to know if Lucene can search using the http url address or database to index from. As current I can only see Lucene being able to search physical files in a windows folder. Any ideas? -- View this message in context: http://www.nabble.com/Lucene-Dynamic-http-Web-Page-Search-tf1867982.html#a5104440 Sent from the Lucene - C Developer forum at Nabble.com.
Sorry, meant to send it to java-dev. Regards, Ning Ning Li Search Technologies IBM Almaden Research Center 650 Harry Road San Jose, CA 95120
Content-type: text/plain; charset=US-ASCII
Today, applications have to open/close an IndexWriter and open/close an
IndexReader directly or indirectly (via IndexModifier) in order to handle a
mix of inserts and deletes. This performs well when inserts and deletes
come in fairly large batches. However, the performance can degrade
dramatically when inserts and deletes are interleaved in small batches.
This is because the ramDirectory is flushed to disk whenever an IndexWriter
is closed, causing a lot of small segments to be created on disk, which
eventually need to be merged.
We would like to propose a small API change to eliminate this problem. We
are aware that this kind change has come up in discusions before. See
http://www.gossamer-threads.com/lists/lucene/java-dev/23049?search_string=indexwriter%20delete;#23049
. The difference this time is that we have implemented the change and
tested its performance, as described below.
API Changes
-----------
We propose adding a "deleteDocuments(Term term)" method to IndexWriter.
Using this method, inserts and deletes can be interleaved using the same
IndexWriter.
Note that, with this change it would be very easy to add another method to
IndexWriter for updating documents, allowing applications to avoid a
separate delete and insert to update a document.
Also note that this change can co-exist with the existing APIs for deleting
documents using an IndexReader. But if our proposal is accepted, we think
those APIs should probably be deprecated.
Coding Changes
--------------
Coding changes are localized to IndexWriter. Internally, the new
deleteDocuments() method works by buffering the terms to be deleted.
Deletes are deferred until the ramDirectory is flushed to disk, either
because it becomes full or because the IndexWriter is closed. Using Java
synchronization, care is taken to ensure that an interleaved sequence of
inserts and deletes for the same document are properly serialized.
We have attached a modified version of IndexWriter in Release 1.9.1 with
these changes. Only a few hundred lines of coding changes are needed. All
changes are commented by "CHANGE". We have also attached a modified version
of an example from Chapter 2.2 of Lucene in Action.
Performance Results
-------------------
To test the performance our proposed changes, we ran some experiments using
the TREC WT 10G dataset. The experiments were run on a dual 2.4 Ghz Intel
Xeon server running Linux. The disk storage was configured as RAID0 array
with 5 drives. Before indexes were built, the input documents were parsed
to remove the HTML from them (i.e., only the text was indexed). This was
done to minimize the impact of parsing on performance. A simple
WhitespaceAnalyzer was used during index build.
We experimented with three workloads:
- Insert only. 1.6M documents were inserted and the final
index size was 2.3GB.
- Insert/delete (big batches). The same documents were
inserted, but 25% were deleted. 1000 documents were
deleted for every 4000 inserted.
- Insert/delete (small batches). In this case, 5 documents
were deleted for every 20 inserted.
current current new
Workload IndexWriter IndexModifier IndexWriter
-----------------------------------------------------------------------
Insert only 116 min 119 min 116 min
Insert/delete (big batches) -- 135 min 125 min
Insert/delete (small batches) -- 338 min 134 min
As the experiments show, with the proposed changes, the performance
improved by 60% when inserts and deletes were interleaved in small batches.
(See attached file: IndexWriter.java)(See attached file:
TestWriterDelete.java)
Regards,
Ning
Ning Li
Search Technologies
IBM Almaden Research Center
650 Harry Road
San Jose, CA 95120
Excuse my ignorance. I'll have to go find that mailing list. Sorry for your inconvenience. On 4/11/06, Garrett Rooney <rooneg@electricjellyfish.net> wrote: > > On 4/11/06, Tim Archambault <tarchambault@bangordailynews.net> wrote: > > Using Ajax, I'd like the search box on my website to perform like GOOGLE > > SUGGEST. > > > > When opening a Lucene index with LUKE, I noticed I can review the top > "X" > > terms within the "body" element. What I'd like to do is extract those > values > > so they can be displayed in my GOOGLE SUGGEST search box as the user > types > > in the keyword(s). > > > > Any thoughts on what elements I should be reviewing within the Lucene > index > > is greatly appreciated. > > This question should probably be directed to the Lucene Users mailing > list, not the development list for a C port of Lucene. > > -garrett >
On 4/11/06, Tim Archambault <tarchambault@bangordailynews.net> wrote: > Using Ajax, I'd like the search box on my website to perform like GOOGLE > SUGGEST. > > When opening a Lucene index with LUKE, I noticed I can review the top "X" > terms within the "body" element. What I'd like to do is extract those values > so they can be displayed in my GOOGLE SUGGEST search box as the user types > in the keyword(s). > > Any thoughts on what elements I should be reviewing within the Lucene index > is greatly appreciated. This question should probably be directed to the Lucene Users mailing list, not the development list for a C port of Lucene. -garrett
Using Ajax, I'd like the search box on my website to perform like GOOGLE SUGGEST. When opening a Lucene index with LUKE, I noticed I can review the top "X" terms within the "body" element. What I'd like to do is extract those values so they can be displayed in my GOOGLE SUGGEST search box as the user types in the keyword(s). Any thoughts on what elements I should be reviewing within the Lucene index is greatly appreciated.
Garrett Rooney schrieb: > On 3/20/06, anton feldmann <anton.feldmann@uni-bielefeld.de> wrote: > >> Hi >> >> i want to write a search engine in c are there examples? >> > > Unfortunately, lucene4c is incomplete. The closest thing to examples > that currently exist are the unit tests, but be warned that you will > hit bugs if you try to use it. Fixes for any problems you find would > be most appreciated though. > > -garrett > thanks alot i am going to try tomorrow all the best anton
On 3/20/06, anton feldmann <anton.feldmann@uni-bielefeld.de> wrote: > Hi > > i want to write a search engine in c are there examples? Unfortunately, lucene4c is incomplete. The closest thing to examples that currently exist are the unit tests, but be warned that you will hit bugs if you try to use it. Fixes for any problems you find would be most appreciated though. -garrett
Hi i want to write a search engine in c are there examples? cherrs anton feldmann
I am writing a program to search into an PDF document. I have problems
with generate an index file outof a lot of pdf documents. I want that i
can store more than one pdfFile into the indexFile and i want to that
the program is giving back the 1. file (apsolutepath) 2. word and lexem
3. score 4. and line how do i get n pdf documents in one indexfile
stored by 1, 2, 4?
i wrote a program that make an index of my filesystem and i can search
in the filesystem to find files. i can not read pdf files and pars them
with lucene.
i want to have an analyzer for all language lucene works with.
IndexWriter write = new IndexWriter(index, new GermanAnalyzer(),
true);
i use only the germananalyzer.
cheers
anton feldmann
On 2/24/06, yueyu lin <popeyelin@gmail.com> wrote: > And the last question is if the project is active. I've seen that project > since last year but now it's almost the same like the one last year. What > kind of help do you need? Maybe I can have some shots on it. Unfortunately, nobody has had time to work on Lucene4c in quite some time. The last time there was any activity the plan was to move from a full C implementation to a wrapper around a GCJ compiled version of Java Lucene. This was basically working, but it wasn't overly reliable, with most of the problems coming from either difficulty getting it to build or difficulty integrating compiled Java code with C code via GCJ's CNI. If you're interested in helping, all the code is available in Subversion at http://svn.apache.org/repos/asf/incuabtor/lucene4c/trunk, or if you want the older version that was pure C there's a tag at http://svn.apache.org/repos/asf/incubator/lucene4c/tags/pre-gcj-conversion/ -garrett
Hi, I'm a Lucene for java's user. Now I'm exciting to see the Lucene4C. As I know before, there's another project named CLucene. That project is using CPP that I'm not good at it. Lucene4c is another good choice for me. But when I review the current svn, I found there were most of .cxx,.hxx files. Although in these files, I found the main part is implemented in "extern "C"" part. But I see "using ...". Does ansi C have name space concept now? I'm afraid that project will try to be compatiable for both C and C++ because many features will be implemented like cpp that will be strange from my view point. I don't think C grammar is not a burden to build a high quality project, do you think so? And the last question is if the project is active. I've seen that project since last year but now it's almost the same like the one last year. What kind of help do you need? Maybe I can have some shots on it. -- -- Yueyu Lin
Folks, Your report is well overdue, and were it not for the fact that the Board pushed back their meeting by a week this month, the Incubator report would have already been submitted, noting that yours had not been submitted. Please get your report posted IMMEDIATELY. The report is being accumulated at: http://wiki.apache.org/incubator/IncubatorBoardReport2005Q4 This is a quarterly obligation for all ASF projects, Incubator or otherwise. It was announced to everyone weeks ago. Please do not be late again. Also, a number of projects have not updated their STATUS files. Please do so immediately. If you do not know how, ask your Mentor. If that doesn't work, please notify the Incubator PMC. --- Noel
I can't find anywhere, a Lucene example for indexing and full-text searching of a simple database table, to return table rows ranked by relevance, not documents. An example with word-stemming would be best, although I gather this happens automatically in the analysis step. Someone has recommended dbsight.net. It's not clear what this buys me as it looks like I'd still have to build a Lucene index from my databse table, using Java code. (Is this right?) Does anyone know of a Lucene-only example for querying tables? Or is there an alternative to DBSight that's easier to use or with more documentation? Thanks, rene'
On 8/8/05, Erik Hatcher <erik@ehatchersolutions.com> wrote: > Thomas - have you had a look at PyLucene and how they do the gcj/SWIG > wizardry? What kinds of issues did you encounter with gcj? Perhaps > Andi Vajda from PyLucene could offer some advice? > > I'd rather see the gcj/SWIG approach moving forward so that SWIG > Lucene doesn't lag behind Java Lucene where all the innovation happens. Yep, I tried to compile PyLucene on my Mac, but it failed because of the Python version that comes with Mac OS 10.4 (which is 2.3). To be fair to PyLucene, I only tried for a couple of hours as I don't really have an interest in Python, I actually only wanted to see how they use gcj. But aside from that, I tried the PyLucene way first for a whole week. First the issue of getting to run gcj on Mac OS X which ain't easy at all - I had to install darwinports with a fresh gcc. Getting gcj to run over Lucene is easy, works out of the box. But linking ruby with swig-wrapped gcj-compiled lucene is not, all I got is a gcj internal compiler error (with both gcc/gcj 3.4.3 and 4.0.1). This bug is in the gcc bug list marked as a regression. On Windows I had a similar amount of trouble using both MingW and cygwin; I wasn't able to compile & link the stuff against ruby. So to summarize, while there is definitely a strong argument for using gcj to create other-language bindings from the Java-version, there are a few issues that IMO make a strong case for CLucene: * at best gcj is difficult to use; but on Windows & MacOS it is quite involved and difficult. For me it was nearly impossible as I'm no gcc/gcj expert * it prevents or at least makes it extremely difficult to create certain bindings such as COM and C# (perhaps except mono) as MingW is not easily combined with VisualC++ AFAIK. And I don't think that there is any chance of debugging such a combination when a problem arises. * the amount of work necessary to swig-wrap the gcj-compiled Lucene to a given target language is immense - just have a look at the swig file of PyLucene and the Makefile to make the magic happen; I think this must be a nightmare to maintain. I cannot really tell what amount of work would be necessary for CLucene but since it is a straight C++ library and built with swig in mind, I would be surprised if it is not a lot less So from a technical point of view, it is my opinion that a pure C++ version is easier to maintain and evolve right now. I also think that most of the innovation in Lucene is not Java-specific so while it would be duplicated implementation work, the algorithms are the same (or near enough). Also, a pure C++ version of Lucene gives it more momentum IMO in both the Linux world (mbox_lucene or something similar comes to mind) and the Microsoft world (.Net etc.) > As for Lucene4C versus CLucene and moving CLucene to Apache - I'll > let the c-dev@lucene list discuss it. I'm happy to have CLucene at > Apache too, though it seems simpler for us to only house a single > implementation in C. The gcj version would be ideal in my mind, but > I'm also not skilled in gcj (and haven't touched C in decades, > practically) - so it certainly is up to the actual coders where to go > with it. I don't know whether it is a "Lucene4C vs. CLucene" anyway. From what I understand Lucene4C tries to create a simpler API for Lucene, and while they are building on top of a gcj-compiled version of Java Lucene, that is likely not a requirement (I don't think that they want to expose any of the gcj-generated classes). Besides, CLucene is quite far so from a practical point of view it would make sense to use /maintain it. Being the practical guy that I am, I think that any issues between Lucene4C, PyLucene, CLucene can be worked out if the developers work together. After all, for all I know it might even be possible to use a mixture of the Lucene4C API (for plain C) and the CLucene API (for C++) in front of a gcj-compiled Java Lucene, and all SWIG wrappers could then be build on top of this API. At lest technically this is possible and perhaps even feasible. regards, Tom
Thomas - have you had a look at PyLucene and how they do the gcj/SWIG
wizardry? What kinds of issues did you encounter with gcj? Perhaps
Andi Vajda from PyLucene could offer some advice?
I'd rather see the gcj/SWIG approach moving forward so that SWIG
Lucene doesn't lag behind Java Lucene where all the innovation happens.
As for Lucene4C versus CLucene and moving CLucene to Apache - I'll
let the c-dev@lucene list discuss it. I'm happy to have CLucene at
Apache too, though it seems simpler for us to only house a single
implementation in C. The gcj version would be ideal in my mind, but
I'm also not skilled in gcj (and haven't touched C in decades,
practically) - so it certainly is up to the actual coders where to go
with it.
Erik
On Aug 8, 2005, at 8:36 AM, Brian McCallister wrote:
> At ApacheCon EU I roped one of the most productive developers
> (Thomas Dudziak) I know (who also has SWIG experience =) into the
> Ruby/Lucene thing. Anyway, he's had little success with gcj and
> lucene4c thus far (lucene4c isn't quite complete enough, and as
> Garrett knows (and said he's working on) kind of tough to build.
>
> Anyway, Thomas went and in an afternoon put SWIG bindings around
> CLucene =)
>
> Now, the more fun part, Ben (whose email I don't have) of CLucene
> would like to move the project to Apache =)
>
> Thoughts?
>
> -Brian
>
> On Aug 8, 2005, at 6:34 AM, Thomas Dudziak wrote:
>
>
>> Hi,
>>
>> after much tinkering and installing/reinstalling gcc/gcj (3.4.3 and
>> 4.0.1) I finally got a combo of ruby+swig+gcj to compile, only to be
>> stopped dead by a internal compiler error of GCJ. I honestly don't
>> know why this works for PyLucene (which btw. I didnt' get to compile
>> because the mac version of Python is 2.3 whereas PyLucene seems to
>> require 2.4).
>>
>> And then yesterday by chance I spotted a mail by Ben van Klinken on
>> the SWIG mailing list who is the lead developer of the CLucene
>> project
>> (http://clucene.sourceforge.net/), a full C++ port of Lucene. So I
>> fired up an email to him and he told me that they've rewritten
>> CLucene
>> to be easily usable with SWIG (currently he's doing a C# and COM
>> wrapper for CLucene) and they already have more or less the
>> functionality as Lucene 1.4.3.
>>
>> So I decided to give it a try, and after about half an hour I not
>> only
>> had CLucene compiled and linked, but also a basic SWIG ruby wrapper
>> around one of the helper classes of CLucene (compared to about a week
>> for the same using gcj).
>>
>> The interesting thing now is that they'd like to move to Apache, they
>> even proposed incubation
>> (http://clucene.sourceforge.net/incubatorproposal.htm) though they
>> seem to be missing a sponsor (Erik didn't answer as far as I could
>> see
>> on the Lucene dev mailing list).
>> I'd very much like to use CLucene as the basis for the ruby binding
>> (and Ben is quite willing to help with any SWIG wrappers and C++
>> issues), so my question is: could you talk to Erik as to whether it
>> would be possible to accept the incubation proposal (via
>> sponsoring by
>> the Lucene PMC) ? From what I saw so far of CLucene, I might be able
>> manage to create a ruby binding of the querying in August, which
>> would
>> be a good start for the RubyLucene repository.
>
I did manage to build and install the pre-gcj-backend version of lucene4c. The SoC guy will have to run with that for now and hopefully when the gcj-backend version works the retrofit won't be too much work. Thanks for all your help guys. Steve
Any chance the core dump is being caused by me linking directly to the liblucene4c.so instead of the .la file? Anyone building lucene4c into a module using the .so file? Anyone have a good liblucene4c.la file I can try to hack up to make work on my systems? Steve
> Stack trace > > #0 0xb71a83b0 in _Jv_RegisterClassHookDefault () from > /usr/lib/libgcj.so.6 > #1 0xb71a8958 in _Jv_RegisterClasses () from > /usr/lib/libgcj.so.6 > #2 0xb7cac7a1 in frame_dummy () from > /usr/local/lucene4c/lib/liblucene4c.so > #3 0xb7cac428 in _init () from > /usr/local/lucene4c/lib/liblucene4c.so > #4 0xb7ff61ce in _dl_catch_error () from > /lib/ld-linux.so.2 > #5 0xb7ff62ba in _dl_init () from /lib/ld-linux.so.2 > #6 0xb7edd2b2 in _dl_open () from /lib/tls/libc.so.6 > #7 0xb7ff6016 in _dl_catch_error () from > /lib/ld-linux.so.2 > #8 0xb7edced6 in _dl_open () from /lib/tls/libc.so.6 > #9 0xb7f0b038 in dlopen () from /lib/tls/libdl.so.2 > #10 0xb7ff6016 in _dl_catch_error () from > /lib/ld-linux.so.2 > #11 0xb7f0b4a6 in dlerror () from /lib/tls/libdl.so.2 > #12 0xb7f0afe4 in dlopen () from /lib/tls/libdl.so.2 > #13 0xb7fa32c3 in apr_dso_load (res_handle=0xbffff888, > path=0x8115da0 > "/usr/local/apache2/modules/mod_mbox.so", > pool=0x80bc0a8) > at dso.c:138 > #14 0x0807e010 in load_module (cmd=0xbffffa58, > dummy=0xbffff910, > modname=0x8115d78 "mbox_module", > filename=0x8115d88 "modules/mod_mbox.so") > at mod_so.c:240 > #15 0x08080cb6 in invoke_cmd (cmd=0x80a77c0, > parms=0xbffffa58, > mconfig=0xbffff910, args=0x80ff1da "") at > config.c:797 > #16 0x0808155e in ap_build_config_sub (p=Variable "p" > is not available. > ) at config.c:1335 > #17 0x080819ce in ap_build_config (parms=0xbffffa58, > p=0x80bc0a8, > ---Type <return> to continue, or q <return> to quit--- > temp_pool=0x80fd1a8, conftree=0x80b2c48) at > config.c:1127 > #18 0x080820d0 in process_resource_config_nofnmatch > (s=0x80c0800, fname=Variable "fname" is not available. > ) > at config.c:1513 > #19 0x08082438 in ap_process_resource_config > (s=0x80c0800, > fname=0x80f8d00 > "/usr/local/apache2/conf/httpd.conf", > conftree=0x80b2c48, > p=0x80bc0a8, ptemp=0x80fd1a8) at config.c:1549 > #20 0x08082c1f in ap_read_config (process=0x80bc0a8, > ptemp=0x80fd1a8, > filename=0x80a8416 "conf/httpd.conf", > conftree=0x80b2c48) at config.c:1892 > #21 0x08084beb in main (argc=2, argv=0xbffffcf4) at > main.c:589 > Well, if it's crashing inside _Jv_RegisterClassHookDefault, then perhaps looking at that function in the GCC source would give us a clue what is going wrong. I don't actually have time to look myself, at least not right now, but if you find anything interesting there please let me know. Other than that I'm running out of ideas, this may not be a problem that can be solved without me actually poking around at it myself, and if so I probably won't get to spend much time with it until this weekend. -garrett
--- Garrett Rooney <rooneg@electricjellyfish.net>
wrote:
> Well, the only reason you need the trunk version of
> APR for Lucene4C is
> that Paul fixed some problems with jlibtool in the
> trunk and those fixes
> aren't available in a released version yet. You
> could try copying the
> trunk's version of jlibtool.c over to the older APR,
> build that APR with
> --enable-experimental-libtool, then build
> everything from scratch
> using that version of APR. I can't recall if
> anything in Lucene4C
> enforces the use of a current version of APR, but if
> it does it probably
> isn't hard to work around.
>
> -garrett
>
I built lucene4c with the apr that comes with the
httpd tarball (with the jlibtool.c from the trunk).
No change in symptoms. Stack trace looks very
similar. here is the data:
ldd mod_mbox.so
libexpat.so.1 =>
/usr/lib/libexpat.so.1 (0xb7fc7000)
liblucene4c.so =>
/usr/local/lucene4c/lib/liblucene4c.so (0xb7e21000)
libapr-0.so.0 =>
/usr/local/apache2/lib/libapr-0.so.0 (0xb7e00000)
librt.so.1 => /lib/tls/librt.so.1 (0xb7dfa000)
libm.so.6 => /lib/tls/libm.so.6 (0xb7dd8000)
libcrypt.so.1 => /lib/tls/libcrypt.so.1
(0xb7dab000)
libnsl.so.1 => /lib/tls/libnsl.so.1
(0xb7d97000)
libpthread.so.0 => /lib/tls/libpthread.so.0
(0xb7d87000)
libdl.so.2 => /lib/tls/libdl.so.2 (0xb7d84000)
libaprutil-0.so.0 =>
/usr/local/apache2/lib/libaprutil-0.so.0 (0xb7d70000)
libc.so.6 => /lib/tls/libc.so.6 (0xb7c3b000)
libgcj.so.6 => /usr/lib/libgcj.so.6
(0xb6b70000)
libgcc_s.so.1 => /lib/libgcc_s.so.1
(0xb6b64000)
libz.so.1 => /usr/lib/libz.so.1 (0xb6b52000)
/lib/ld-linux.so.2 => /lib/ld-linux.so.2
(0x80000000)
ldd liblucene4c.so
libgcj.so.6 => /usr/lib/libgcj.so.6
(0xb6d82000)
libapr-0.so =>
/usr/local/apr/.libs/libapr-0.so (0xb6d60000)
librt.so.1 => /lib/tls/librt.so.1 (0xb6d5a000)
libm.so.6 => /lib/tls/libm.so.6 (0xb6d38000)
libcrypt.so.1 => /lib/tls/libcrypt.so.1
(0xb6d0b000)
libnsl.so.1 => /lib/tls/libnsl.so.1
(0xb6cf7000)
libpthread.so.0 => /lib/tls/libpthread.so.0
(0xb6ce8000)
libdl.so.2 => /lib/tls/libdl.so.2 (0xb6ce4000)
libgcc_s.so.1 => /lib/libgcc_s.so.1
(0xb6cd9000)
libz.so.1 => /usr/lib/libz.so.1 (0xb6cc7000)
libc.so.6 => /lib/tls/libc.so.6 (0xb6b92000)
/lib/ld-linux.so.2 => /lib/ld-linux.so.2
(0x80000000)
Stack trace
#0 0xb71a83b0 in _Jv_RegisterClassHookDefault () from
/usr/lib/libgcj.so.6
#1 0xb71a8958 in _Jv_RegisterClasses () from
/usr/lib/libgcj.so.6
#2 0xb7cac7a1 in frame_dummy () from
/usr/local/lucene4c/lib/liblucene4c.so
#3 0xb7cac428 in _init () from
/usr/local/lucene4c/lib/liblucene4c.so
#4 0xb7ff61ce in _dl_catch_error () from
/lib/ld-linux.so.2
#5 0xb7ff62ba in _dl_init () from /lib/ld-linux.so.2
#6 0xb7edd2b2 in _dl_open () from /lib/tls/libc.so.6
#7 0xb7ff6016 in _dl_catch_error () from
/lib/ld-linux.so.2
#8 0xb7edced6 in _dl_open () from /lib/tls/libc.so.6
#9 0xb7f0b038 in dlopen () from /lib/tls/libdl.so.2
#10 0xb7ff6016 in _dl_catch_error () from
/lib/ld-linux.so.2
#11 0xb7f0b4a6 in dlerror () from /lib/tls/libdl.so.2
#12 0xb7f0afe4 in dlopen () from /lib/tls/libdl.so.2
#13 0xb7fa32c3 in apr_dso_load (res_handle=0xbffff888,
path=0x8115da0
"/usr/local/apache2/modules/mod_mbox.so",
pool=0x80bc0a8)
at dso.c:138
#14 0x0807e010 in load_module (cmd=0xbffffa58,
dummy=0xbffff910,
modname=0x8115d78 "mbox_module",
filename=0x8115d88 "modules/mod_mbox.so")
at mod_so.c:240
#15 0x08080cb6 in invoke_cmd (cmd=0x80a77c0,
parms=0xbffffa58,
mconfig=0xbffff910, args=0x80ff1da "") at
config.c:797
#16 0x0808155e in ap_build_config_sub (p=Variable "p"
is not available.
) at config.c:1335
#17 0x080819ce in ap_build_config (parms=0xbffffa58,
p=0x80bc0a8,
---Type <return> to continue, or q <return> to quit---
temp_pool=0x80fd1a8, conftree=0x80b2c48) at
config.c:1127
#18 0x080820d0 in process_resource_config_nofnmatch
(s=0x80c0800, fname=Variable "fname" is not available.
)
at config.c:1513
#19 0x08082438 in ap_process_resource_config
(s=0x80c0800,
fname=0x80f8d00
"/usr/local/apache2/conf/httpd.conf",
conftree=0x80b2c48,
p=0x80bc0a8, ptemp=0x80fd1a8) at config.c:1549
#20 0x08082c1f in ap_read_config (process=0x80bc0a8,
ptemp=0x80fd1a8,
filename=0x80a8416 "conf/httpd.conf",
conftree=0x80b2c48) at config.c:1892
#21 0x08084beb in main (argc=2, argv=0xbffffcf4) at
main.c:589
steve johnson wrote: > >>Well, first off, one is linked against libapr-0.so >>and one is linked >>with libapr-1.so, that's probably a bad thing... >>I'd suggest making >>sure everything is linked against one or the other, >>and trying again. >> >>-garrett >> > > Ok, seems reasonable but I'm not sure how it can be > done. httpd won't build with the version of apr that > lucene4c requires. And mod_mbox builds with apxs which > uses the same libraries as httpd. Even if I could > rebuild mod_mbox with the version lucene4c wants I > would probably end up in the same situation because of > the version difference between the httpd and mod_mbox. Well, the only reason you need the trunk version of APR for Lucene4C is that Paul fixed some problems with jlibtool in the trunk and those fixes aren't available in a released version yet. You could try copying the trunk's version of jlibtool.c over to the older APR, build that APR with --enable-experimental-libtool, then build everything from scratch using that version of APR. I can't recall if anything in Lucene4C enforces the use of a current version of APR, but if it does it probably isn't hard to work around. -garrett
> > Well, first off, one is linked against libapr-0.so > and one is linked > with libapr-1.so, that's probably a bad thing... > I'd suggest making > sure everything is linked against one or the other, > and trying again. > > -garrett > Ok, seems reasonable but I'm not sure how it can be done. httpd won't build with the version of apr that lucene4c requires. And mod_mbox builds with apxs which uses the same libraries as httpd. Even if I could rebuild mod_mbox with the version lucene4c wants I would probably end up in the same situation because of the version difference between the httpd and mod_mbox.