Mailing-List: contact dev-help@couchdb.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@couchdb.apache.org
MIME-Version: 1.0
From: Constantin Teodorescu <brailateo@gmail.com>
Date: Sat, 30 Jul 2016 15:17:41 +0300
Message-ID: <CABHX5yLDo6__h9pnPRTu8fodfXOdLE8QAZZE95MCh92yZuKwTw@mail.gmail.com>
Subject: Mango full text search is immune to accented letters?
To: dev@couchdb.apache.org
Content-Type: multipart/alternative; boundary=047d7b86c8724d66a30538d95ccf
archived-at: Sat, 30 Jul 2016 12:18:16 -0000

--047d7b86c8724d66a30538d95ccf
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Is Mango Full text indexer/search (or would it be) immune for accented
letters?

I'm planning to use it for searching "posta" but it may be "po=C5=9Ft=C4=83=
" in
documents!
SQLite3 FTS4 is able to do that!

For the moment I'm using CouchDB 1.6 views with explicit "flatten function"
in JavaScript to create a non-accented index:

  var translate_re =3D /[=C5=9E=C8=98=C5=A2=C8=9A=C3=8E=C4=82=C3=82=C3=81=
=C5=9F=C8=99=C5=A3=C8=9B=C3=AE=C4=83=C3=A2=C3=A1]/g,
      translate =3D {
        '=C5=9E': 'S', '=C5=9F': 's',
        '=C8=98': 'S', '=C8=99': 's',
        '=C5=A2': 'T', '=C5=A3': 't',
        '=C8=9A': 'T', '=C8=9B': 't',
        '=C4=82': 'A', '=C4=83': 'a',
        '=C3=82': 'A', '=C3=A2': 'a',
        '=C3=81': 'A', '=C3=A1': 'a',
        '=C3=8E': 'I', '=C3=AE': 'i'
      };

    function makeSearchString(s) {
        return ( s.replace(translate_re, function(match) {
          return translate[match];
        }) );
    }

Teo

--047d7b86c8724d66a30538d95ccf--