camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Claus Ibsen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CAMEL-8150) camel-hdfs sending message per chunk, not per file
Date Wed, 17 Dec 2014 07:10:14 GMT

     [ https://issues.apache.org/jira/browse/CAMEL-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Claus Ibsen updated CAMEL-8150:
-------------------------------
    Issue Type: Task  (was: Improvement)

> camel-hdfs sending message per chunk, not per file
> --------------------------------------------------
>
>                 Key: CAMEL-8150
>                 URL: https://issues.apache.org/jira/browse/CAMEL-8150
>             Project: Camel
>          Issue Type: Task
>          Components: camel-hdfs, documentation
>    Affects Versions: 2.14.0
>            Reporter: Josef Ludvíček
>
> When hdfs consumer picks orinary file, it sends message per data chunk. 
> Not message per file as one could expect.
> In the docs it is mentioned only in option description, which can be overlooked very
easily.
> It should be explicitly written in the beginning of the [component doc page | https://camel.apache.org/hdfs2].
> Option description from docs
> |chunkSize | 4096 | When reading a normal file, this is split into chunks producing a
message per chunk. |
> Sample camel route (workaround could be to add {{?fileExist=Append}} to file component)
> {code:xml}
>  <camel:route id="toFile">
>             <from uri="hdfs2:localhost:8020/tmp/camel-test/"/>
>             <log message="picked up file from hdfs with name $simple{header.CamelFileName}"/>
>             <to uri="file:test-dest"/>
>             <log message="file downloaded from hadoop"/>
> </camel:route>
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message