nifi-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Moser (JIRA)" <>
Subject [jira] [Commented] (NIFI-2787) PersistentProvenanceRepository rollover can fail on immense indexed attributes
Date Tue, 20 Sep 2016 19:12:20 GMT


Michael Moser commented on NIFI-2787:

Using 1.1.0-SNAPSHOT the provenance rollover and index doesn't fail, presumably due to fixes
in NIFI-2395.  But this indicates that NIFI-2429 would really be useful to have in 0.x.

> PersistentProvenanceRepository rollover can fail on immense indexed attributes
> ------------------------------------------------------------------------------
>                 Key: NIFI-2787
>                 URL:
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.0.0, 0.7.0
>            Reporter: Michael Moser
> Accidentally created an immense attribute (36,000 bytes), which I indexed with nifi.provenance.repository.indexed.attributes.
 Received this error.
> ERROR [Provenance Repository Rollover Thread-1] o.a.n.p.PersistentProvenanceRepository
Failed to rollover Provenance repository due to java.lang.IllegalArgumentException: Document
contains at least one immense term in field="FOO" (whose UTF8 encoding is longer than the
max length 32766), all of which were skipped. Please correct the analyzer to not produce such
> Perhaps this is as simple as changing
to 32766 to match Lucene.  Investigation & testing needed.
> For background, this Lucene ticket made exceeding the term size limit an IllegalArgumentException

This message was sent by Atlassian JIRA

View raw message