Mailing-List: contact user-help@uima.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@uima.apache.org
From: Hugues de Mazancourt <hugues@mazancourt.com>
Content-Type: multipart/alternative;
 boundary="Apple-Mail=_0A1694DB-FA16-406F-B617-1703F46642DF"
Mime-Version: 1.0 (Mac OS X Mail 10.1 \(3251\))
Subject: Re: New dictionary annotator
Date: Fri, 2 Dec 2016 10:02:44 +0100
References: <CACb1XVEkU=tP8wQdPQ0ZbO-L1rH8eLvFtxNWQFeT2qPBqERRFw@mail.gmail.com>
To: user@uima.apache.org
In-Reply-To: <CACb1XVEkU=tP8wQdPQ0ZbO-L1rH8eLvFtxNWQFeT2qPBqERRFw@mail.gmail.com>
Message-Id: <51E1FE83-551A-4ADD-90E7-8F6CFBAF2AE0@mazancourt.com>
archived-at: Fri, 02 Dec 2016 09:02:52 -0000

--Apple-Mail=_0A1694DB-FA16-406F-B617-1703F46642DF
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

Thanks for this contribution.

Do you have any plan to make the lookup accent-insensitive ? Or any =
knowledge of a component that would do the job ?
I=E2=80=99m currently using ConceptMapper outside of Ruta and MARKTABLE =
from within Ruta but neither performs correctly on accents (btw, =
conceptMapper is *very* slow on resource loading, which can be a =
problem).

My point is : I have lists containing elements like =C2=AB =C3=A9v=C3=A9ne=
ment =C2=BB and I would like text like =C2=AB EVENEMENT =C2=BB or even =
=C2=AB =C3=A9v=C3=A8nement =C2=BB to match that list. Lowercasing texts =
is not a solution, as =C2=AB =C3=A9 =C2=BB is mapped to uppercase =C2=AB =
=C3=89 =C2=BB in French locale, which has nothing to do with =C2=AB e =
=C2=BB. I guess you have the same problem with latvian.

Best,


Hugues de Mazancourt
http://about.me/mazancourt


> Le 30 nov. 2016 =C3=A0 15:38, Donatas Remeika =
<donatas.remeika@gmail.com> a =C3=A9crit :
>=20
> Hi,
>=20
> Just wanted to let you know that we created a new (probably one more)
> dictionary annotator.
>=20
> Reasons for creating it was:
> - Quite often we used Ruta in our pipelines only because of its =
MARKTABLE
> action which is able to set several features on annotation
> - Sometimes dictionaries contain duplicate entries with different =
features
> and we need to create annotations for each entry
> - Possibility to use custom dictionary entries tokenizer (default is
> whitespace tokenizer)
>=20
> It was inspired by both DKPro dictionary-annotator and Ruta MARKTABLE. =
Big
> thanks to their developers!
>=20
> Code with examples can be found
> https://github.com/tokenmill/dictionary-annotator
>=20
> BTW, maybe someone knows Concept Mapper alternative, which is more =
uimaFIT
> friendly?
>=20
> Best regards,
> Donatas


--Apple-Mail=_0A1694DB-FA16-406F-B617-1703F46642DF--