nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravi Papisetti (rpapiset)" <rpapi...@cisco.com>
Subject Re: SplitText is throwing ArrayIndexOutofBoundException
Date Tue, 18 Apr 2017 16:01:12 GMT
Thank you for the references, Kyle. I did remove templates from flow.xml.gz and removed content
from all repos resolved issue.

Thanks,
Ravi Papisetti

From: Kyle Richardson <kylerichardson2@gmail.com>
Reply-To: "users@nifi.apache.org" <users@nifi.apache.org>
Date: Tuesday, April 18, 2017 at 9:54 AM
To: "users@nifi.apache.org" <users@nifi.apache.org>
Subject: Re: SplitText is throwing ArrayIndexOutofBoundException

Ravi,

You may be running into the same issue I did in v1.1.2. Below is the stack trace from my case.
I found that I was running into either NIFI-3495 or NIFI-3278 or both, and that upgrading
to the latest master build (1.2.0-SNAPSHOT) resolved the issue.

2017-04-11 16:10:20,703 ERROR [Timer-Driven Process Thread-3] o.a.nifi.processors.standard.SplitText
java.lang.ArrayIndexOutOfBoundsException: 8192
        at org.apache.nifi.stream.io.util.TextLineDemarcator.isEol(TextLineDemarcator.java:162)
~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:113)
~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.stream.io.util.TextLineDemarcator.nextOffsetInfo(TextLineDemarcator.java:85)
~[nifi-utils-1.1.2.jar:1.1.2]
        at org.apache.nifi.processors.standard.SplitText.nextSplit(SplitText.java:405) ~[na:na]
        at org.apache.nifi.processors.standard.SplitText.access$600(SplitText.java:86) ~[na:na]
        at org.apache.nifi.processors.standard.SplitText$1.process(SplitText.java:238) ~[na:na]
        at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2082)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2053)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.processors.standard.SplitText.onTrigger(SplitText.java:206) ~[na:na]
        at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
~[nifi-api-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099)
~[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
[nifi-framework-core-1.1.2.jar:1.1.2]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121]
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_121]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_121]
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]

-Kyle


On Thu, Apr 13, 2017 at 9:41 PM, James Wing <jvwing@gmail.com<mailto:jvwing@gmail.com>>
wrote:
Ravi,
Can you share a sample of the data you are splitting and the settings of the SplitText processor?
 Is there more error stack trace information?
Thanks,
James

On Thu, Apr 13, 2017 at 3:42 PM, Ravi Papisetti (rpapiset) <rpapiset@cisco.com<mailto:rpapiset@cisco.com>>
wrote:
Hi,

Using Apache Nifi 1.1.2 single node machine, fetching files from hdfs using FetchHDFS and
sending to SplitText. I see SplitText is throwing arrayindexoutofboundexception for CSV files.
It works fine for TAB separated files.

Below are exception details:

ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText SplitText[id=10001177-1788-1506-fe7c-2d411cab157b]
SplitText[id=10001177-1788-1506-fe7c-2d411cab157b] failed to process due to java.lang.ArrayIndexOutOfBoundsException;
rolling back session: java.lang.ArrayIndexOutOfBoundsException

2017-04-13 07:37:39,262 ERROR [Timer-Driven Process Thread-5] o.a.nifi.processors.standard.SplitText

java.lang.ArrayIndexOutOfBoundsException: null


Any thoughts why this can be thrown by SplitText processor?

Appreciate any help.

Thanks,
Ravi Papisetti


Mime
View raw message