nifi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NIFI-938) Appending to FlowFiles Errors Finding Content - GetKafka
Date Mon, 14 Sep 2015 15:47:45 GMT

    [ https://issues.apache.org/jira/browse/NIFI-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743695#comment-14743695
] 

ASF subversion and git services commented on NIFI-938:
------------------------------------------------------

Commit 3d4ce34529533ff801a2febae7e669248cb80324 in nifi's branch refs/heads/master from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=3d4ce34 ]

NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete
the claim


> Appending to FlowFiles Errors Finding Content - GetKafka
> --------------------------------------------------------
>
>                 Key: NIFI-938
>                 URL: https://issues.apache.org/jira/browse/NIFI-938
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Brian Ghigiarelli
>            Assignee: Mark Payne
>            Priority: Critical
>             Fix For: 0.3.0
>
>         Attachments: 0001-NIFI-938-If-ResourceClaim-is-removed-while-a-process.patch
>
>
> With the latest 0.3.0-SNAPSHOT on the master branch, GetKafka throws errors only when
the Batch Size is greater than 1.  NiFi is unable to find the existing FlowFile in order to
append new content to it.
> {noformat}
> 2015-09-08 15:36:36,643 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.kafka.GetKafka
GetKafka[id=6eec6998-c271-4de3-b092-42469d9b494c] Failed to receive FlowFile from Kafka due
to org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content for
FlowFile: org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content
for FlowFile
> 2015-09-08 15:36:36,644 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.kafka.GetKafka
> org.apache.nifi.processor.exception.MissingFlowFileException: Unable to find content
for FlowFile
>         at org.apache.nifi.controller.repository.StandardProcessSession.handleContentNotFound(StandardProcessSession.java:2333)
~[na:na]
>         at org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2028)
~[na:na]
>         at org.apache.nifi.processors.kafka.GetKafka.onTrigger(GetKafka.java:313) ~[nifi-kafka-processors-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
[nifi-api-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1077)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:127)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_45]
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_45]
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_45]
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_45]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> Caused by: org.apache.nifi.controller.repository.ContentNotFoundException: Could not
find content for org.apache.nifi.controller.repository.claim.StandardContentClaim@90a96e21
>         at org.apache.nifi.controller.repository.FileSystemRepository.getPath(FileSystemRepository.java:490)
~[na:na]
>         at org.apache.nifi.controller.repository.FileSystemRepository.read(FileSystemRepository.java:795)
~[na:na]
>         at org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:1988)
~[na:na]
>         ... 13 common frames omitted
> 2015-09-08 15:36:36,644 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.kafka.GetKafka
GetKafka[id=6eec6998-c271-4de3-b092-42469d9b494c] GetKafka[id=6eec6998-c271-4de3-b092-42469d9b494c]
failed to process due to org.apache.nifi.processor.exception.FlowFileHandlingException: StandardFlowFileRecord[uuid=5ae54a81-1db5-4106-b4f4-dce41771a6b4,claim=org.apache.nifi.controller.repository.claim.StandardContentClaim@90a96e21,offset=0,name=56655239492779,size=3644]
is not known in this session (StandardProcessSession[id=175]); rolling back session: org.apache.nifi.processor.exception.FlowFileHandlingException:
StandardFlowFileRecord[uuid=5ae54a81-1db5-4106-b4f4-dce41771a6b4,claim=org.apache.nifi.controller.repository.claim.StandardContentClaim@90a96e21,offset=0,name=56655239492779,size=3644]
is not known in this session (StandardProcessSession[id=175])
> 2015-09-08 15:36:36,644 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.kafka.GetKafka
> org.apache.nifi.processor.exception.FlowFileHandlingException: StandardFlowFileRecord[uuid=5ae54a81-1db5-4106-b4f4-dce41771a6b4,claim=org.apache.nifi.controller.repository.claim.StandardContentClaim@90a96e21,offset=0,name=56655239492779,size=3644]
is not known in this session (StandardProcessSession[id=175])
>         at org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:2345)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.repository.StandardProcessSession.remove(StandardProcessSession.java:1567)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.processors.kafka.GetKafka.onTrigger(GetKafka.java:338) ~[nifi-kafka-processors-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
~[nifi-api-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1077)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:127)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119)
[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_45]
>         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_45]
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_45]
>         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_45]
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_45]
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_45]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message