Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2FA50200BBF for ; Mon, 14 Nov 2016 19:58:04 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 2E375160B06; Mon, 14 Nov 2016 18:58:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5444A160AF4 for ; Mon, 14 Nov 2016 19:58:03 +0100 (CET) Received: (qmail 38797 invoked by uid 500); 14 Nov 2016 18:58:01 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 38787 invoked by uid 99); 14 Nov 2016 18:58:01 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Nov 2016 18:58:01 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id F0A23C744B for ; Mon, 14 Nov 2016 18:58:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id ZQecpTAkVCN3 for ; Mon, 14 Nov 2016 18:57:58 +0000 (UTC) Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com [209.85.161.178]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 3A4AF5F24C for ; Mon, 14 Nov 2016 18:57:58 +0000 (UTC) Received: by mail-yw0-f178.google.com with SMTP id i145so73442029ywg.2 for ; Mon, 14 Nov 2016 10:57:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=y1PVRyhXpmyt9csIOIx7pvLvdbUDaZThW4fiXOgFIyI=; b=QVL6U13aqV+E8jJXG7NaMu0xCIusBYXOOFfMP8lVzEANcVXkux0BdklfZBEubii8ln F2bgHLkhK35Ji7gZOyc/2N7YXUJLg9ce6JXO70FM2Q4feCN69YGisjwLlce5Hc1XTSGt C2FHXZ5XdoiuyJI+x5E09XQNb94PUjgU31cTUvCYPoxSH/1vxksiigaWHxVsJxZCcnX0 ftWgf7OC2dyw2aAv2gooH/M+8jbun7LDD0KGYjykMd+Ztx8bCjgkxnRhTDhlmQUODKcG CNGqximqIQs5Xwrp3EpkpTz2EIUT6r2Y/EiE4obWRo/v0UNaAEjlpVTEMeVsmxhKbOof Pd5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=y1PVRyhXpmyt9csIOIx7pvLvdbUDaZThW4fiXOgFIyI=; b=iIp8DhPpSYgxcwBQGAL/Ntx7VM9mTWROMrAdUHsVQZmfaQDjQ02NRoUKf5DIwlJZX6 mqkBsQ9gXrFEZt3LgXYkifbO2hZ2To5XO7Q32E0cWBMIlhCrHdvhPPDk5saMsYfiQFeN RuoLKn5vG/zuBq1lj9ME2vAI8CqlyOtD3hFGwaPYlD1oZAPN6p7pLNouEMMeV2JTwTKe Pz+X5H59mwXRo8qlzDcQvDaJz6IiRxRez2T1ykhbU/y1g/FAQ9s32A4l/4SuWXWCKXJ4 Re7zPWiYVDLqMaBYaRkh4NBxo0gsKMhSN1CZ9sVKcnI6r+ciUXu0GLU75xcyRAIWeHJh qqkA== X-Gm-Message-State: ABUngvcacv8AkVv3ouFwsl4spUE8bmi8KbQ+8pOYBGBsSq+00oE7ZzkVrHlfDhAIt7pRoaCCbn9ZJf73Xu6ERg== X-Received: by 10.202.71.207 with SMTP id u198mr8536900oia.165.1479149876937; Mon, 14 Nov 2016 10:57:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.182.112.196 with HTTP; Mon, 14 Nov 2016 10:57:36 -0800 (PST) In-Reply-To: References: <19037B86-CAEA-45DE-A95A-7CB044C8FA5C@airstreamcomm.net> From: Paulo Motta Date: Mon, 14 Nov 2016 16:57:36 -0200 Message-ID: Subject: Re: Storing videos in cassandra To: "user@cassandra.apache.org" Content-Type: multipart/alternative; boundary=001a113e574efc073c0541476a0c archived-at: Mon, 14 Nov 2016 18:58:04 -0000 --001a113e574efc073c0541476a0c Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable For the record, there is an interesting use case of globo.com using Cassandra to store video payload and stream live video at scale (in particular, the FIFA World Cup + Olympics), but it's a pretty non-conventional/advanced use case: - https://leandromoreira.com.br/2015/04/26/fifa-2014-world-cup-live-stream-ar= chitecture/ - https://www.javacodegeeks.com/2016/06/cassandra-heart-globos-live-streaming= -platform.html 2016-11-14 16:56 GMT-02:00 Benjamin Roth : > Some time ago, I stumbled across this: https://github.com/ > chrislusf/seaweedfs > It is an open source implementation of Facebooks Haystack design. Have no > experience yet but we will evaluate it as a blob-store to replace our > Mogile-FS installation which stores over one billion images. From my poin= t > of view it looks very promising and probably much more resource-friendly > for this use case. > > Maybe that helps ... > > 2016-11-14 19:52 GMT+01:00 Jon Haddad : > >> While Cassandra *can* be used this way, I don=E2=80=99t recommend it. I= t=E2=80=99s going >> to be far cheaper and easier to maintain to store data in an Object stor= e >> like S3, like Oskar recommended. >> >> > On Nov 14, 2016, at 10:16 AM, list@airstreamcomm.net wrote: >> > >> > We store videos and files in Cassandra by chunking them into small >> portions and saving them as blobs. As for video you could track the fil= e >> byte offset of each chunk and request the relevant pieces when scrubbing= to >> a particular portion of the video. >> > >> >> On Nov 14, 2016, at 11:02 AM, raghavendra vutti < >> raghu9raghavendra@gmail.com> wrote: >> >> >> >> Hi, >> >> >> >> Just wanted to know How does hulu or netflix store videos in cassandr= a. >> >> >> >> Do they just use references to the video files in the form of URL's >> and store in the DB?? >> >> >> >> could someone please me on this. >> >> >> >> >> >> Thanks, >> >> Raghavendra. >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > >> > >> >> > > > -- > Benjamin Roth > Prokurist > > Jaumo GmbH =C2=B7 www.jaumo.com > Wehrstra=C3=9Fe 46 =C2=B7 73035 G=C3=B6ppingen =C2=B7 Germany > Phone +49 7161 304880-6 =C2=B7 Fax +49 7161 304880-1 > AG Ulm =C2=B7 HRB 731058 =C2=B7 Managing Director: Jens Kammerer > --001a113e574efc073c0541476a0c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
For the record, there is an interesting use case of globo.com using Cassandra to store video payload= and stream live video at scale (in particular, the FIFA World Cup + Olympi= cs), but it's a pretty non-conventional/advanced use case:
-=C2=A0<= a href=3D"https://leandromoreira.com.br/2015/04/26/fifa-2014-world-cup-live= -stream-architecture/">https://leandromoreira.com.br/2015/04/26/fifa-2014-w= orld-cup-live-stream-architecture/

2016-11-14 16:56 GMT-02:00 Benjamin Roth <b= enjamin.roth@jaumo.com>:
Some time ago, I stumbled across this:=C2=A0https://github.com/chrislusf/seaweedfs
It is an open source implementation of Facebo= oks Haystack design. Have no experience yet but we will evaluate it as a bl= ob-store to replace our Mogile-FS installation which stores over one billio= n images. From my point of view it looks very promising and probably much m= ore resource-friendly for this use case.

Maybe tha= t helps ...
2016-11-14 19:52 GMT+01:00 Jon Haddad <jonathan.haddad@gmail.com>:
While Cassandra *can* be used this way, I don=E2=80=99t recommend it.=C2= =A0 It=E2=80=99s going to be far cheaper and easier to maintain to store da= ta in an Object store like S3, like Oskar recommended.

> On Nov 14, 2016, at 10:16 AM, list@airstreamcomm.net wrote:
>
> We store videos and files in Cassandra by chunking them into small por= tions and saving them as blobs.=C2=A0 As for video you could track the file= byte offset of each chunk and request the relevant pieces when scrubbing t= o a particular portion of the video.
>
>> On Nov 14, 2016, at 11:02 AM, raghavendra vutti <raghu9raghavendra@gmail.= com> wrote:
>>
>> Hi,
>>
>> Just wanted to know How does hulu or netflix store videos in cassa= ndra.
>>
>> Do they just use references to the video files in the form of URL&= #39;s and store in the DB??
>>
>> could someone please me on this.
>>
>>
>> Thanks,
>> Raghavendra.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
>




<= /div>--
Benjamin Roth
Prokurist

Jaumo GmbH =C2=B7 www.jaumo.com
Wehrstra= =C3=9Fe 46 =C2=B7 73035 G=C3=B6ppingen =C2=B7 Germany
Phone +49 = 7161 304880-6 =C2=B7 Fax +49 7161 304880-1
AG Ulm =C2= =B7 HRB 731058 =C2=B7 Managing Director: Jens Kammerer

--001a113e574efc073c0541476a0c--