Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 52136 invoked from network); 22 Apr 2008 20:56:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 22 Apr 2008 20:56:00 -0000 Received: (qmail 85303 invoked by uid 500); 22 Apr 2008 20:55:58 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 85059 invoked by uid 500); 22 Apr 2008 20:55:57 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 85048 invoked by uid 99); 22 Apr 2008 20:55:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Apr 2008 13:55:57 -0700 X-ASF-Spam-Status: No, hits=2.8 required=10.0 tests=RCVD_IN_DNSWL_LOW,RCVD_NUMERIC_HELO,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [69.50.2.13] (HELO ex9.myhostedexchange.com) (69.50.2.13) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Apr 2008 20:55:12 +0000 Received: from 206.169.1.36 ([206.169.1.36]) by ex9.hostedexchange.local ([172.16.69.18]) with Microsoft Exchange Server HTTP-DAV ; Tue, 22 Apr 2008 20:55:22 +0000 User-Agent: Microsoft-Entourage/11.3.3.061214 Date: Tue, 22 Apr 2008 13:54:15 -0700 Subject: Re: Can Hadoop process pictures and videos? From: Ted Dunning To: Message-ID: Thread-Topic: Can Hadoop process pictures and videos? Thread-Index: Acikuj3eGcyBRQazRhuK3RTvsxtE2gAAMhXC In-Reply-To: Mime-version: 1.0 Content-type: text/plain; charset="US-ASCII" Content-transfer-encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Yes you can. One issue is typically that linux based video codecs are not as numberous as windows based codecs so you may be a bit limited as to what kinds of video you can process. Also, most video processing and transcoding is embarrassingly parallel at the file level with little need for map-reduce. That may make hadoop less useful than it might otherwise be. On the other hand, hadoop does expose URL's from which you can read file data so you might be just as happy using that. On 4/22/08 1:48 PM, "Roland Rabben" wrote: > Hi > > Sorry for my ignorance, but I am trying to understand if I can use > Hadoop and Map/Reduce to process video files and images. Encoding and > transcoding videos is an example of what I would like to do. > > > > Thank you for your patience. > > > > Regards > > Roland >