camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Willem Jiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CAMEL-5971) HdfsOutputStream is not closing
Date Thu, 17 Jan 2013 07:04:14 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13555934#comment-13555934
] 

Willem Jiang commented on CAMEL-5971:
-------------------------------------

Yeah, from the usage of the user, it looks like we need to change the file name dynamically.

I think most people uses HDFS to store the large size file, so we didn't hit this kind of
request before.

                
> HdfsOutputStream is not closing
> -------------------------------
>
>                 Key: CAMEL-5971
>                 URL: https://issues.apache.org/jira/browse/CAMEL-5971
>             Project: Camel
>          Issue Type: Bug
>          Components: camel-hdfs
>    Affects Versions: 2.10.3
>            Reporter: Joe Luo
>            Assignee: Willem Jiang
>             Fix For: 2.10.4, 2.11.0
>
>
> I have a simple camel route that takes file from a camel-file consumer endpoint and sends
to a camel-hdfs producer endpoint:
> <from uri="file:/local/workspace/inbox?delete=true"/>
> <to uri="hdfs://localhost:9000/local/workspace/outbox/file1"/>
> However, my Hadoop server only creates a zero length file "file1.opened" unless I stop
camel route or a splitting condition is met with a "splitStratedy" option added to URI. In
above cases, a file called "file1" is created with proper contents and the "file1.opened"
is disappeared.  
> It looks like that close() function of HdfsOutputStream is never called unless the camel
route/context is stopping or we are splitting the file by looking at source code.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message