Return-Path: Delivered-To: apmail-lucene-general-archive@www.apache.org Received: (qmail 80279 invoked from network); 24 Jun 2009 04:17:18 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 24 Jun 2009 04:17:18 -0000 Received: (qmail 55492 invoked by uid 500); 24 Jun 2009 04:17:28 -0000 Delivered-To: apmail-lucene-general-archive@lucene.apache.org Received: (qmail 55457 invoked by uid 500); 24 Jun 2009 04:17:28 -0000 Mailing-List: contact general-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@lucene.apache.org Delivered-To: mailing list general@lucene.apache.org Received: (qmail 55447 invoked by uid 99); 24 Jun 2009 04:17:28 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Jun 2009 04:17:28 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [206.190.39.202] (HELO web50311.mail.re2.yahoo.com) (206.190.39.202) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 24 Jun 2009 04:17:18 +0000 Received: (qmail 4510 invoked by uid 60001); 24 Jun 2009 04:16:57 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1245817016; bh=ULIrZUuJxm9vYmx+u1AKEzxxkshIgQTwy2ANFDzN7L4=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=gENJ9TualjIkXhGNg6Es8no4Y0J/pcyzpOn+RrjD28KqrDN704Cj2EkHG6n/PlGTx/ez8l+NrleOl5ttRStowFoRlmh46asZ36cJELx++cmXtvPuPns+j8OtqJ71YEaDmo+5+u96/VVP6XqEjXlW9ehaIurNM6XzIEAIq373zGI= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=1odfDJ+iZQhUsxTCXH/kbXNLlWUHhQnHGQzNd1MSri3BqswWSn9RVPM4p8T1NHJP8J3viXBvazlRs2W/t1eGynMDnMraoayyRt+5KQ/SRsAWGDtYfrWkY60x1nH+VeVvQz496juGELY1w9OX6CfuS4AWIK0nROZSpzGRGxbmDsI=; Message-ID: <993243.3739.qm@web50311.mail.re2.yahoo.com> X-YMail-OSG: 1LV4z14VM1kjZBd.T8Nelt3e_cdIEVWsKTkdhyo48QgOsUWSQDrzEtA_HdJcJ5hblaTMibuOflqSLxLXP_SwTEX6fSGC8QNW6YE0L4qnht3DD5mHaJY0rJYhmtodvNvJ8OgoYbq0vBufPm8_CXjbvUswlTxS0T0I4NP8GHWbI.7RFnk8_Xc2PvDp3vfJK1apd.hUUGnpKAB6pPzxwdArvb0Q5x.0us_BluH3q6E.Dxjdu1vVztOuoFhLLhtIZSxV_b5bg30sQoROESQTFQBay74m.9h7Hpurbp5DSwwAlAqDDM.HBd10UFcywpL8eNQfgseZxukqZxuoaaI1ReGbVwqVqrXxZEk5uA2va9Z3sSB1joakKTtdvw-- Received: from [74.73.30.59] by web50311.mail.re2.yahoo.com via HTTP; Tue, 23 Jun 2009 21:16:56 PDT X-Mailer: YahooMailRC/1277.43 YahooMailWebService/0.7.289.15 References: <26face530906232052r5fa886f2k76c156db4502eb27@mail.gmail.com> Date: Tue, 23 Jun 2009 21:16:56 -0700 (PDT) From: Otis Gospodnetic Subject: Re: Using Lucene to index OSM nodes (400M latitude/longitude points) To: general@lucene.apache.org In-Reply-To: <26face530906232052r5fa886f2k76c156db4502eb27@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Checked: Checked by ClamAV on apache.org Hi Kelly, I think you want to look at LocalLucene (or LocalSolr). I haven't played with Local*, so I can't provide more than this tip. Actually, I can also suggest to dump Plucene - it's a dead project, and even when it was alive it was quite slow. If you really need to be able to search from a Perl application, your best bet may be using a Perl Solr client. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: Kelly Jones > To: general@lucene.apache.org > Sent: Tuesday, June 23, 2009 11:52:48 PM > Subject: Using Lucene to index OSM nodes (400M latitude/longitude points) > > Can Lucene index the openstreetmap.org (OSM) node db (400M > latitude/longitude pairs), and then find the 20 nodes closest to a > given latitude/longitude? > > More specifically: > > % Can Lucene index numerical data and understand that 16 is close to > 15, but far away from 160000? > > % Is Lucene reasonably fast indexing 400M floating point pairs? > > % After Lucene creates the 400M index, can it return search results > reasonably fast? > > % Is there a guide/tutorial that shows how to use Lucene to index > numerical data (I'm using Plucene, but I'll settle for any sort of > guide)? > > I tried to index OSM data w/ SQLite3, but it took forever. > > I realize I could use MySQL/PostgreSQL, but I'm looking for an > embedded/serverless solution. > > -- > We're just a Bunch Of Regular Guys, a collective group that's trying > to understand and assimilate technology. We feel that resistance to > new ideas and technology is unwise and ultimately futile.