Mailing-List: contact dev-help@httpd.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@httpd.apache.org
Received-SPF: pass (asf.osuosl.org: domain of bvchaosinc@gmail.com designates
 64.233.184.196 as permitted sender)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
        s=beta; d=gmail.com;
        h=received:message-id:date:from:to:subject:mime-version:content-type;
        b=I/cXwK32Aofva0qg/xpXBETJy0Uv8RUCCW98Sc+fr41V9F8aRFiZOsWHh0qP0GzOJWsxawzvntu+td5bsMh3gp2oyAjzM/MB5FRqfBEwx+D8xUAUU5sbZRAFX1C66ju27uR1Ho3daj/5u5mGlNcNquseLzKFODbd2vH8eBPuApQ=
Message-ID: <96ae002305090518086fb5f944@mail.gmail.com>
Date: Mon, 5 Sep 2005 21:08:36 -0400
From: russell johnson <bvchaosinc@gmail.com>
To: dev@httpd.apache.org
Subject: mod_mbox search code
Mime-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----=_Part_3628_1910531.1125968916220"

------=_Part_3628_1910531.1125968916220
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Hello every one

This is the first code release of the mod_mbox search SoC project. I used=
=20
the mysql full test search feature as the backbone of this search feature=
=20
for mod_mbox. To make an connection pool with mysql I used a combination of=
=20
libdbi and mod_dbipool. Libdbi also provided functions to help protect from=
=20
SQL injection attacks.=20

The UI for the search is non-existent right now I will be working with=20
Maxime Petazzoni soon to integrate my search into his new mod_mbox UI. Righ=
t=20
now there is an apache handler in my code if you want to test the search. I=
t=20
is not meant to be use in any other capacity and so is very inefficient and=
=20
causes some problem with the rest of mod_mbox functions. There are a few=20
variables in mod_mbox_sreach.c to change for the search input and the outpu=
t=20
goes straight to error_log.=20
=20
The field variable can be "subject", "body", "subject,body" depending on=20
what part/parts of the message you want to search.=20

The type variable can be "bool" or "notbool" depending on if you want a=20
natural language search or a Boolean search.=20
This article http://mysqld.active-venture.com/Fulltext_Search.html or the=
=20
mysql manual explains the search types and syntax well.=20

The search_terms variable is where your search query goes as one big string=
.=20
"I'm looking for this".=20

To make the table just set up an mysql database of any name and use the per=
l=20
scripts in /home/russ/ in this tar file.=20

To make a new table and add all the .mbox files in a directory.
./make_fts_db <mysql database name> <mysql user> <mysql password> <path to=
=20
.mbox files>

To add a .mbox file to the table.
./update_fts_db <mysql database name> <mysql user> <mysql password> <path t=
o=20
a .mbox file>

A tarball of this code can be found here:
http://www.clanbv.org/public/mod_mbox/=20
I am very open to critiques and comments so please let me know what you=20
think

Russell

------=_Part_3628_1910531.1125968916220
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

<p>Hello every one</p>


<p style=3D"text-indent: 0.5in;"><span>&nbsp;</span>This is the
first code release of the mod_mbox search SoC project.<span>&nbsp; </span>I=
 used the mysql full test search feature as the
backbone of this search feature for mod_mbox.<span>&nbsp; </span>To make an=
 connection pool with mysql I used a combination of libdbi and
mod_dbipool.<span>&nbsp; </span>Libdbi also provided functions
to help protect from SQL injection attacks.<span>&nbsp;</span>&nbsp;</p>


<p>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
 The UI for the search is
non-existent right now I will be working with Maxime Petazzoni soon to
integrate my search into his new mod_mbox UI.<span>&nbsp;
</span>Right now there is an apache handler in my code if you want to test =
the
search. <span>&nbsp;</span>It is not meant to be use in any
other capacity and so is very inefficient and causes some problem with the =
rest
of mod_mbox functions. There are a few variables in mod_mbox_sreach.c to ch=
ange
for the search input and the output goes straight to error_log.<span>&nbsp;=
</span><br>
</p>


<p>The field variable can be &quot;subject&quot;, &quot;body&quot;, &quot;s=
ubject,body&quot;
depending on what part/parts of the message you want to search.<span>&nbsp;=
 </span></p>


<p>The type variable can be &quot;bool&quot; or &quot;notbool&quot; dependi=
ng on if
you want a natural language search or a Boolean search.<span>&nbsp;</span><=
br>
This article <a href=3D"http://mysqld.active-venture.com/Fulltext_Search.ht=
ml" target=3D"_blank" onclick=3D"return top.js.OpenExtLink(window,event,thi=
s)">http://mysqld.active-venture.com/Fulltext_Search.html</a>
or the mysql manual explains the search types and syntax well.&nbsp;</p>


<p>The search_terms variable is where your search query goes as
one big string. &quot;I'm looking for this&quot;.<span>&nbsp; </span></p>


<p>To make the table just set up an mysql database of any name
and use the perl scripts in /home/russ/ in this tar file.<span>&nbsp;</span=
>&nbsp;</p>


<p>To make a new table and add all the .mbox files in a directory.<br>
./make_fts_db &lt;mysql database name&gt; &lt;mysql user&gt; &lt;mysql
password&gt; &lt;path to .mbox files&gt;</p>


<p>To add a .mbox file to the table.<br>
./update_fts_db &lt;mysql database name&gt; &lt;mysql user&gt; &lt;mysql
password&gt; &lt;path to a .mbox file&gt;</p>


<p>A tarball of this code can be found here:<br>
<a href=3D"http://www.clanbv.org/public/mod_mbox/" target=3D"_blank" onclic=
k=3D"return top.js.OpenExtLink(window,event,this)">http://www.clanbv.org/pu=
blic/mod_mbox/</a>&nbsp;</p>


I am very open to critiques and comments so please let me
know what you think<br>

<br>

Russell


------=_Part_3628_1910531.1125968916220--