falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkatesh Seetharam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-579) Lineage breaks if feed.xml doesn't have the date pattern in feed path location
Date Tue, 02 Sep 2014 20:50:21 GMT

    [ https://issues.apache.org/jira/browse/FALCON-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118718#comment-14118718
] 

Venkatesh Seetharam commented on FALCON-579:
--------------------------------------------

bq. Am hoping that his hasn't triggered FALCON-580. Please consider storing a default &
constant time value for all such instances to avoid collision.
[~sriksun], this is not related to FALCON-580 but this is a bug/oversight I think on my part
assuming feeds will always have a dated partition. We have nominal time as the default now.

However, FALCON-580 is a bigger hole IMHO. Lets discuss this there.

> Lineage breaks if feed.xml doesn't have the date pattern in feed path location
> ------------------------------------------------------------------------------
>
>                 Key: FALCON-579
>                 URL: https://issues.apache.org/jira/browse/FALCON-579
>             Project: Falcon
>          Issue Type: Sub-task
>            Reporter: Sowmya Ramesh
>            Assignee: Sowmya Ramesh
>             Fix For: 0.6
>
>         Attachments: FALCON-579.patch, FALCON-579.v1.patch, FALCON-579.v2.patch, feed.xml
>
>
> Lineage breaks if feed.xml doesn't have the date pattern in feed path.
> {code}
> Stack trace:
> 2014-08-07 18:00:24,385 INFO  - [ActiveMQ Session Task:] ~ Computing feed instance for
: name=input-feed, path= hdfs://master.hortonworks.com:8020/landing/data, in cluster: KLSS
(InstanceRelationshipGraphBuilder:173)
> 2014-08-07 18:00:24,389 INFO  - [ActiveMQ Session Task:] ~ Error in onMessage for subscriber
of topic: FALCON.ENTITY.TOPIC (FalconTopicSubscriber:136)
> java.lang.RuntimeException: java.text.ParseException: Unparseable date: ""
>         at org.apache.falcon.entity.v0.SchemaHelper.formatDateUTCToISO8601(SchemaHelper.java:68)
>         at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFileSystemFeedInstanceName(InstanceRelationshipGraphBuilder.java:230)
>         at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:203)
>         at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addFeedInstance(InstanceRelationshipGraphBuilder.java:175)
>         at org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addInputFeedInstances(InstanceRelationshipGraphBuilder.java:163)
>         at org.apache.falcon.metadata.MetadataMappingService.onProcessInstanceAdded(MetadataMappingService.java:284)
>         at org.apache.falcon.metadata.MetadataMappingService.onSuccessfulWorkflowCompletion(MetadataMappingService.java:265)
>         at org.apache.falcon.service.FalconTopicSubscriber.notifyMetadataMappingService(FalconTopicSubscriber.java:144)
>         at org.apache.falcon.service.FalconTopicSubscriber.onMessage(FalconTopicSubscriber.java:129)
>         at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
>         at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
>         at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
>         at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
>         at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: java.text.ParseException: Unparseable date: ""
>         at java.text.DateFormat.parse(DateFormat.java:357)
>         at org.apache.falcon.entity.v0.SchemaHelper.formatDateUTCToISO8601(SchemaHelper.java:66)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message