nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Neil Derraugh <neil.derra...@intellifylearning.com>
Subject QueryRecord not closing stream before committing session
Date Wed, 13 Sep 2017 14:01:40 GMT
Seeing this warning and the subsequent error in a dataflow we recently
authored.  Bryan, looks like the same thing you were asking details of
on Hortonworks
Community Connection
<https://community.hortonworks.com/questions/118295/nifi-filttering-records-from-avro-file-error.html>
.

This is a QueryRecord processor consuming a schema in the Schema Registry
using a CSVReader and CSVRecordSetWriter.  Cache Schema and Include Zero
Record FlowFiles are set to false.

2017-09-13 09:54:42,628 WARN [Timer-Driven Process Thread-7]
o.a.n.c.r.StandardProcessSession StandardProcessSession[id=36915342]
closing
ErrorHandlingInputStream[FlowFile=StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878,
container=default, section=830], offset=0,
length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]]
for
StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878,
container=default, section=830], offset=0,
length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
because the session was committed without the stream being closed.

2017-09-13 09:54:42,628 ERROR [Timer-Driven Process Thread-7]
o.a.nifi.processors.standard.QueryRecord
QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4]
QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4] failed to process
session due to java.lang.IllegalStateException:
StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878,
container=default, section=830], offset=0,
length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
already in use for an active callback or an InputStream created by
ProcessSession.read(FlowFile) has not been closed: {}
java.lang.IllegalStateException:
StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878,
container=default, section=830], offset=0,
length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
already in use for an active callback or an InputStream created by
ProcessSession.read(FlowFile) has not been closed
at
org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3018)
at
org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3013)
at
org.apache.nifi.controller.repository.StandardProcessSession.transfer(StandardProcessSession.java:1815)
at
org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:355)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)

Mime
View raw message