hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gautam Singaraju <gautam.singar...@gmail.com>
Subject DBOutputFormat over SSH?
Date Fri, 23 Apr 2010 04:18:16 GMT

I have a use-case where I need to crunch a large amount of data and
push to the results (comparatively a smaller set) to a mysql db at a
remote location. As per security concerns, only SSH ports are open. I
tried using Java Secure Channel [1] in combination with some custom
JDBC code from the reducers.

Can anyone comment on the performance of DBOutputFormat? Have there
been any efforts to tunnel this through SSH? This is going to be an
expensive operation; any suggestions would be welcome.

[1] http://www.jcraft.com/jsch/
Gautam Singaraju

View raw message