nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Payne <marka...@hotmail.com>
Subject Re: QueryRecord not closing stream before committing session
Date Wed, 13 Sep 2017 14:15:08 GMT
Neil,

Do you have any other errors in your log? Specifically, if you search for "Unable to query"
do you find anything?
This appears to be a problem with the failure handling logic, but it would only get into this
state if another failure occurred.
That other failure should be logged starting with "Unable to query".

Thanks
-Mark


On Sep 13, 2017, at 10:01 AM, Neil Derraugh <neil.derraugh@intellifylearning.com<mailto:neil.derraugh@intellifylearning.com>>
wrote:

Seeing this warning and the subsequent error in a dataflow we recently authored.  Bryan, looks
like the same thing you were asking details of on Hortonworks Community Connection<https://community.hortonworks.com/questions/118295/nifi-filttering-records-from-avro-file-error.html>.

This is a QueryRecord processor consuming a schema in the Schema Registry using a CSVReader
and CSVRecordSetWriter.  Cache Schema and Include Zero Record FlowFiles are set to false.

2017-09-13 09:54:42,628 WARN [Timer-Driven Process Thread-7] o.a.n.c.r.StandardProcessSession
StandardProcessSession[id=36915342] closing ErrorHandlingInputStream[FlowFile=StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830],
offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]]
for StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830],
offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
because the session was committed without the stream being closed.

2017-09-13 09:54:42,628 ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.standard.QueryRecord
QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4] QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4]
failed to process session due to java.lang.IllegalStateException: StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830],
offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
already in use for an active callback or an InputStream created by ProcessSession.read(FlowFile)
has not been closed: {}
java.lang.IllegalStateException: StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830],
offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]
already in use for an active callback or an InputStream created by ProcessSession.read(FlowFile)
has not been closed
at org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3018)
at org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3013)
at org.apache.nifi.controller.repository.StandardProcessSession.transfer(StandardProcessSession.java:1815)
at org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:355)
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)


Mime
View raw message