From general-return-775-apmail-hadoop-general-archive=hadoop.apache.org@hadoop.apache.org Mon Nov 23 23:46:33 2009 Return-Path: Delivered-To: apmail-hadoop-general-archive@minotaur.apache.org Received: (qmail 95535 invoked from network); 23 Nov 2009 23:46:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 23 Nov 2009 23:46:32 -0000 Received: (qmail 10464 invoked by uid 500); 23 Nov 2009 23:46:32 -0000 Delivered-To: apmail-hadoop-general-archive@hadoop.apache.org Received: (qmail 10379 invoked by uid 500); 23 Nov 2009 23:46:31 -0000 Mailing-List: contact general-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: general@hadoop.apache.org Delivered-To: mailing list general@hadoop.apache.org Received: (qmail 10369 invoked by uid 99); 23 Nov 2009 23:46:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Nov 2009 23:46:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [209.191.125.39] (HELO web38408.mail.mud.yahoo.com) (209.191.125.39) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 23 Nov 2009 23:46:22 +0000 Received: (qmail 23378 invoked by uid 60001); 23 Nov 2009 23:46:00 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1259019960; bh=XgvPyWXksNrXV+zgxWv9taB+BfA6iHOq2lhigN8pYeU=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=X1eSxLy8ThkEYCNjwYtEgWMY0lhSQ53EOxP/SMJlDvKovFEpdaPO2WYqlhXuhgJgRn0Cxo+bbkcvAmZ2l/RiEbINSul3aY3isicU3rzMWdAXZ19ekQQT/qcUohGviKtTmSOVbXaHRmBVfm2uCDBQuLlf3Y7wT2z6piO73ruc1bQ= DomainKey-Signature:a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=2LisUGCucoigqblj5T6SXZ4aPUj5AOAV2/OwGu2iMQbzauZdfmYfLWbNT3b7Wrk3+o7vhCh3ZqQFqCb5lu6BwuHZJlkrYrHmj7Ho3egGNPeanWEY5IcKmIB4AzolrOJexmBdtJZoeu080haBj18syGtw/V9as/WXfSasg0+BA+I=; Message-ID: <38943.23289.qm@web38408.mail.mud.yahoo.com> X-YMail-OSG: TVmsMr8VM1korGUJUipoJIO46_NvrnwF1hsZ11OYkO._kL0uZ9di96pKWhWAwxfYoid_HiudBH5dP6N1RoK._L0dE3bEjbuOk_vTvuFRWrfGtA9DOuzI0J.9QPYqp2lSx50kN0SjXbiS.ZNoppF23y_XoQH4NKCddnfaznKmo7TCFFR90baerODcWHRf9C6JPEWQC8ZCiLxIjggjcXw74el.9zIXv5RmBQAkYArTqzlW5TT8ICJmTAKOpFhBrmFxwCeW5PvUxX.XzLmZG.vdK_0O2Lmnv1zodl5VNtBPM8kYoK20fIqE_Npeb1gJcsmNDDBIVhfCkpuLi2ju0cw0.Q-- Received: from [129.170.212.188] by web38408.mail.mud.yahoo.com via HTTP; Mon, 23 Nov 2009 15:46:00 PST X-Mailer: YahooMailRC/211.6 YahooMailWebService/0.8.100.260964 Date: Mon, 23 Nov 2009 15:46:00 -0800 (PST) From: himanshu chandola Subject: Size of BytesWritable To: general@hadoop.apache.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Checked: Checked by ClamAV on apache.org Hi Everyone, I am writing binary files using SequenceFile.Writer and what I am seeing is that the resulting file is much greater than what it should be. Here's my calculation, if someone can point out what is wrong in this it would be great: A Sequence File should have its own header : some constant bytes. Every BytesWritable written to the sequence file should be : number of bytes in the byte array for the BytesWritable plus an object header (probably 4 bytes for the header). The total size of the file should be the sum of the above two. Is this fine ? Thanks Himanshu Morpheus: Do you believe in fate, Neo? Neo: No. Morpheus: Why Not? Neo: Because I don't like the idea that I'm not in control of my life.