hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <jason.had...@gmail.com>
Subject Re: Using Hadoop for File Conversion
Date Mon, 12 Oct 2009 15:39:51 GMT
Hadoop is very well suited for file conversion.
Do you have any more specific questions?

What you might do is give your hadoop job as input, a file or set of files
containing the paths or urls to the images you wish to convert
Then in your map task, load the image file, apply your conversion and save
it to your desired location, and then output the new location path/url as
the output of your map task.

You may wish to store the image files in hadoop.

On Mon, Oct 12, 2009 at 8:06 AM, davydany <davydany@live.com> wrote:

> Hi all,
> I'm very new to Hadoop and I am using the Pro Hadoop book to learn. I'm
> doing a project for class, where we are required to learn and use Hadoop.
> We
> are supposed to use Hadoop for converting large amounts of photos into 3
> different sizes (one is a thumbnail, next is optimized for mobile devices
> and the other is stretched to fit a large screen [image quality is not our
> priority here]).
> I heard that NYTimes used Hadoop to convert 4TB of TIFFs into PDFs. Now, my
> real question is this: Can I use hadoop for file conversion?
> Thanks!
> --
> View this message in context:
> http://www.nabble.com/Using-Hadoop-for-File-Conversion-tp25857346p25857346.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.

Pro Hadoop, a book to guide you from beginner to hadoop mastery,
www.prohadoopbook.com a community for Hadoop Professionals

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message