Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A3C2B9A07 for ; Mon, 2 Apr 2012 09:24:13 +0000 (UTC) Received: (qmail 71838 invoked by uid 500); 2 Apr 2012 09:24:11 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 71776 invoked by uid 500); 2 Apr 2012 09:24:11 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 71754 invoked by uid 99); 2 Apr 2012 09:24:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Apr 2012 09:24:10 +0000 X-ASF-Spam-Status: No, hits=0.6 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [74.125.149.76] (HELO na3sys009aog106.obsmtp.com) (74.125.149.76) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 02 Apr 2012 09:24:02 +0000 Received: from mail-lpp01m010-f41.google.com ([209.85.215.41]) (using TLSv1) by na3sys009aob106.postini.com ([74.125.148.12]) with SMTP ID DSNKT3lwGj5cAhuq7QzZ7acqNtRqkxXkSCco@postini.com; Mon, 02 Apr 2012 02:23:41 PDT Received: by lagz14 with SMTP id z14so3655595lag.0 for ; Mon, 02 Apr 2012 02:23:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type :x-gm-message-state; bh=Ei9C8CQSO6YqPJ/MNkS8qBS7VIXNtTv5H89cKfLy1KM=; b=nmOgsYIeWAKiv8+GA3D5JokthxTZuzKiAn4nhKiXxSuVYneUfwaQveb8UvwpFM5Njq FCatU2VIV+IVHNvr9Na7RbWb4TKq3/UU7wsjrY8Yrj2Ze7KeonOxO02JGvQzUQj+/SH9 h2e7FVTzQwYpXQcchK9xmXnTxBJB4gQqnD4R4fAFbnb1iorisKM2pT0b2/nt6/wPekoI 9aOUxw7xyqEo/a3usa7U8R0cWjD1h60wqGKchKmrmPrziy3s44SEPx3vHLYs0THd+0Dv 5zIOpeNUlKFpg6BbVt1CCWhiKvNxDZY0nRgcbX+L7tljuyghr1gu18CdpwTwFW6hcdDA ACaw== Received: by 10.152.132.6 with SMTP id oq6mr8543289lab.44.1333358616402; Mon, 02 Apr 2012 02:23:36 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.4.169 with HTTP; Mon, 2 Apr 2012 02:23:16 -0700 (PDT) From: Franc Carter Date: Mon, 2 Apr 2012 19:23:16 +1000 Message-ID: Subject: Largest 'sensible' value To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=f46d0433a0fab05b6604bcaebe32 X-Gm-Message-State: ALoCoQn9zYonpt9/T8B1taUc73/3cAUEIiQ1cOE1sdnJj5HmEVXuGsHjCQhWYPEWDtTTQMNOQMDG --f46d0433a0fab05b6604bcaebe32 Content-Type: text/plain; charset=ISO-8859-1 Hi, We are in the early stages of thinking about a project that needs to store data that will be accessed by Hadoop. One of the concerns we have is around the Latency of HDFS as our use case is is not for reading all the data and hence we will need custom RecordReaders etc. I've seen a couple of comments that you shouldn't put large chunks in to a value - however 'large' is not well defined for the range of people using these solutions ;-) Doe anyone have a rough rule of thumb for how big a single value can be before we are outside sanity? thanks -- *Franc Carter* | Systems architect | Sirca Ltd franc.carter@sirca.org.au | www.sirca.org.au Tel: +61 2 9236 9118 Level 9, 80 Clarence St, Sydney NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215 --f46d0433a0fab05b6604bcaebe32 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Hi,

We are in the early stages of thinkin= g about a project that needs to store data that will be accessed by Hadoop.= One of the concerns we have is around the Latency of HDFS as our use case = is is not for reading all the data and hence we will need custom RecordRead= ers etc.

I've seen a couple of comments that you shouldn'= ;t put large chunks in to a value - however 'large' is not well def= ined for the range of people using these solutions ;-)

Doe anyone have a rough rule of thumb for how big a single value can b= e before we are outside sanity?

thanks

--

Franc Carter<= /b> |<= /span> Systems architect | Sirca Ltd

franc.carter@sirca.org.au=A0|=A0www.sirca.org.au

Tel:= =A0+61 2 9236 9118

Level 9, 80 Clarence St, Sydney=A0NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215<= /span>


--f46d0433a0fab05b6604bcaebe32--