lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tomoko Uchida (JIRA)" <>
Subject [jira] [Commented] (LUCENE-8793) Enhanced UI for CustomAnalyzer : show analysis steps
Date Mon, 06 May 2019 06:25:00 GMT


Tomoko Uchida commented on LUCENE-8793:

[~jun_o]: thanks for the nice patch!

I did some sanity checks locally. First of all, this works for me by the ant target: {{ant
-f lucene/luke/build.xml run}} :)

I noticed a few things:

1. Javadocs linter failed, so {{ant precommit}} also failed.
     [echo] checking for broken html...
    [jtidy] FIXME: Broken HTML checks were disabled, as jtidy can't handle HTML5.
     [echo] Checking for broken links...
     [exec] Crawl/parse...
     [exec] Verify...
     [echo] Checking for missing docs...
     [exec] build/docs/luke/org/apache/lucene/luke/app/desktop/components/fragments/analysis/package-summary.html
     [exec]   missing description: SimpleAnalyzeResultPanelOperator.TokensTableModel
     [exec]   missing description: SimpleAnalyzeResultPanelProvider
     [exec]   missing description: StepByStepAnalyzeResultPanelOperator.NamedTokensTableModel
     [exec]   missing description: StepByStepAnalyzeResultPanelProvider
     [exec] Missing javadocs were found!

But we can delay this until all other things are done.

2. Omitting char filters is not intuitive.

I think this patch is not complete without support for the charfilters, because users would
expect whole analysis steps are shown in this panel. Maybe we can show the results for char
filters along with those for tokenizer/tokenfilters by laying out the sub-panels vertically,
not horizontally? (I have not yet checked the details. Just an idea.)

Vertical layout may be also good when you add many filters like this:

!Screenshot from 2019-05-06 13-45-40.png|width=724,height=212!

In this case, I added a char filter and four token filters.

!Screenshot from 2019-05-06 13-46-16.png|width=362,height=216!


3. "Test Analyzer Step by Step" button is visible when a "Preset" analyzer is selected.

The button does not make sense with preset analyzers, because there is always only one step
and the result is identical with "Test Analyzer".

I think this button should not be visible (or at least disabled) when "Preset" is selected.

4. "Test Analyzer Step by Step" could be a checkbox, not a button.

To me, this functionality looks like an option to change "Test Analyzer" behaviour. So I'd
use a checkbox (labeled "step-by-step", for example) to switch the result panel. Do you have
thoughts about this?

And, I just wanted to add comments about the restriction:
{quote}Current patch is only show each tokenizer/filters result independently, so the result
doesn't show deletion/separation by next filter, e.g. "library" by WordDelimiterFilter is
different position between other output.
Except the support for charfilters as I noted above, it seems to be fine to me. This can be
done by another issue (in the future.)

I have not yet checked the code... will do soon.

> Enhanced UI for CustomAnalyzer : show analysis steps
> ----------------------------------------------------
>                 Key: LUCENE-8793
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Improvement
>          Components: modules/luke
>            Reporter: Jun Ohtani
>            Priority: Minor
>         Attachments: LUCENE-8793.patch, Screen Shot 2019-05-06 at 10.00.57.png, Screenshot
from 2019-05-06 13-45-40.png, Screenshot from 2019-05-06 13-46-16.png
> This is a migrated issue from previous Luke project in GitHub: []
> For on-the-fly inspection / debugging, it is desirable to show the more detailed step
by step information in the Custom Analyzer UI.
> This will be just like Solr's Analysis screen,
> []
> or Elasticsearch's {{_analyze}} API and Kibana's Analyzer UI.
> []
> []

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message