hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ian Holsman <li...@holsman.net>
Subject PROPOSAL: Summer of Code 2008 - Integrate Talend with Hadoop.
Date Tue, 11 Mar 2008 04:12:14 GMT
I'd like to volunteer a proposal for the upcoming summer of code project.

Talend is a open source (GPL) data integration tool used by companies to 
transform data from one format to another.

For example I might get 2-3 XML input files that I need to feed into a 
database, or SOLR server. It works really well until you start bumping 
into memory limits or time concerns when you handle large files.

Enter hadoop.

I'd would like to propose a project to write the necessary bits to make 
talend jobs run on a hadoop cluster, possibly using things like pig.

While I understand this code will probably end up as a part of talend's 
code base, I think it would be a neat project to expand hadoop's 
presence in this space.
I'm willing to act as a mentor for it. (I've been a mentor for HTTP, and 
lucene projects in the past)


View raw message