Mailing-List: contact dev-help@ctakes.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@ctakes.apache.org
Received-SPF: pass (athena.apache.org: domain of
 Dmitriy.Dligach@childrens.harvard.edu designates 134.174.13.92 as permitted
 sender)
From: "Dligach, Dmitriy" <Dmitriy.Dligach@childrens.harvard.edu>
To: cTAKES Developer list <dev@ctakes.apache.org>
Subject: Re: lvg entries
Thread-Topic: lvg entries
Thread-Index: Ac9aWeh+8tnv4IK+T8igRnGzLt2WCAAJ+04A
Date: Thu, 17 Apr 2014 17:14:25 +0000
Message-ID: <48B49832-D03A-4B0B-B373-C2760B243EE5@childrens.harvard.edu>
References: <E084D8EFE2B03A408B324458C5212E942435F0D8@CHEXMBX3A.CHBOSTON.ORG>
 <D98CE332-E421-487B-B61F-B411C75387EA@childrens.harvard.edu>
 <E084D8EFE2B03A408B324458C5212E942435F161@CHEXMBX3A.CHBOSTON.ORG>
In-Reply-To: <E084D8EFE2B03A408B324458C5212E942435F161@CHEXMBX3A.CHBOSTON.ORG>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="Windows-1252"
Content-ID: <5538197BEC6F734B88F3DA1D964D3E64@childrens.harvard.edu>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

I don=92t know of any applications within cTAKES that make use of this=85 T=
he reverse (mapping from these =93variants=94 to the normal form) may be us=
eful though.

Dima


On Apr 17, 2014, at 11:50, Miller, Timothy <Timothy.Miller@childrens.harvar=
d.edu> wrote:

> Sure, just as an example, I gave it a note with about 1000 words. It
> generates 11500 NonEmptyFSList elements (each is basically one lexical
> variant).
>=20
> For the word "symptomatic", these are the first 10 of 20 lexical variants=
:
> Symptomaticer/JJ
> Symptomaticer/RB
> Symptomaticed/VB
> Symptomaticcing/VB
> Symptomatics/VB
> Symptomatics/NN
> Symptomaticked/VB
> Symptomatic/VB
> Symptomatic/JJ
> Symptomatic/RB
>=20
> Tim
>=20
>=20
> On 04/17/2014 12:31 PM, Dligach, Dmitriy wrote:
>> Tim, this is a very interesting observation. Could you please send a few=
 examples of what LVG generates? Both sensical and non :)
>>=20
>> Dima
>>=20
>>=20
>>=20
>>=20
>> On Apr 17, 2014, at 11:28, Miller, Timothy <Timothy.Miller@childrens.har=
vard.edu> wrote:
>>=20
>>> The LVG annotator creates an enormous number of "lemmas" for every
>>> WordToken in the CAS, and I'm wondering what the original purpose was? =
I
>>> think this is probably a minor bottleneck for speed but mostly a pretty
>>> big space hog (at least 50% of the space of xmi files in my tests).
>>>=20
>>> As of right now I'm not sure if any downstream components are using
>>> these lemmas, and on a manual inspection the precision seems to be
>>> pretty abysmal (meaning most of them are nonsensical as lexical
>>> variants), so as I said, just wondering if we can revisit why cTAKES
>>> generates so many and whether that component can be optimized.
>>>=20
>>> Thanks
>>> Tim
>>>=20
>>=20
>=20