opennlp-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jörn Kottmann <kottm...@gmail.com>
Subject Re: Detailed FMeasure output
Date Wed, 17 Aug 2011 16:57:50 GMT
Yes, I think that would be useful. We could create a command line
reporter which can print these statistics, at least to start with.

Can that be done with the new listener interface we just created for
our evaluators? If not I suggest that we might rename it, and add also
a method for correctly classified samples to it, or indicate that with a 
flag.

Jörn

On 8/17/11 6:51 PM, william.colen@gmail.com wrote:
> Hi,
>
> Would it be useful to have detailed output from FMeasure while using span
> with types? For example, we should use it to know individual precision and
> recall for person, organization, date in a NameFinder model or for Chunker.
> Something the output from
> CONLL2000<http://www.cnts.ua.ac.be/conll2000/chunking/output.html>
> :
>
>     processed 961 tokens with 459 phrases; found: 539 phrases; correct: 371.
>     accuracy:  84.08%; precision:  68.83%; recall:  80.83%; FB1:  74.35
>                  ADJP: precision:   0.00%; recall:   0.00%; FB1:   0.00
>                  ADVP: precision:  45.45%; recall:  62.50%; FB1:  52.63
>                    NP: precision:  64.98%; recall:  78.63%; FB1:  71.16
>                    PP: precision:  83.18%; recall:  98.89%; FB1:  90.36
>                  SBAR: precision:  66.67%; recall:  33.33%; FB1:  44.44
>                    VP: precision:  69.00%; recall:  79.31%; FB1:  73.80
>
> I will need something like that for my master dissertation. If it is useful
> I would add it to OpenNLP.
>
> Thanks,
> William
>


Mime
View raw message