camel-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daneel Yaitskov (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CAMEL-7080) Add support of lazy load to csv data format
Date Fri, 20 Dec 2013 10:44:10 GMT

    [ https://issues.apache.org/jira/browse/CAMEL-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13853855#comment-13853855
] 

Daneel Yaitskov commented on CAMEL-7080:
----------------------------------------

I did it.

> Add support of lazy load to csv data format 
> --------------------------------------------
>
>                 Key: CAMEL-7080
>                 URL: https://issues.apache.org/jira/browse/CAMEL-7080
>             Project: Camel
>          Issue Type: Improvement
>            Reporter: Daneel S. Yaitskov
>            Assignee: Willem Jiang
>
> CsvDataFormat uses greedy loading from a stream. This is not applicable for huge files
i.e. all rows cannot fit into available memory.
> I added an option to create a row iterator instead list.
> Csv format is not line oriented so split("\n") workaround doesn't work always. This patch
adds ability to Camel to process infinite csv files with multiline rows. 
> Pull request: 
> https://github.com/yaitskov/camel/commits/csv-iterator
> P.S. 
> 1) I found that Bindy does similar work related with parsing csv file into list of why.
And I don't see any clue why it doesn't delegate this job to csv file format. Roughly speaking
there is code duplication.
> 2) I didn't find camel-csv component on the ticket form.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message