hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shraddha Pandhe <shraddha.pan...@gmail.com>
Subject Re: Ways to ingest data into hadoop
Date Wed, 20 Feb 2013 15:12:57 GMT
Hi,

I as far as I know, t hadoop inherently does not support ingesting video
files into HDFS, as video needs to be split on specific video frames. I am
also working on similar problem I actually wrote my own RecordReader and
and InputFormat for video, so that the video block can be submitted to the
Map Task in its entirety. But this only works if you have pre-split the
video using something like ffmpeg, and each split is smaller than your
configured blocksize.


Regards,
Shraddha



On Wed, Feb 20, 2013 at 5:52 AM, Shouvanik Haldar <
shouvanik.haldar@gmail.com> wrote:

> Hi,
>
> I have various sources like -
> 1. video
> 2. audio
> 3. email
> 4. RDBMS
> 5. flat files
> 6. Main Frames
> 7. RFID
>
>
> how to ingest data from the above sources to hadoop
>
>
> Regards,
> Shouvanik
>
> --
> Thanks,
> *Shouvanik*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message