Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0B657F8DD for ; Tue, 9 Apr 2013 18:56:35 +0000 (UTC) Received: (qmail 26730 invoked by uid 500); 9 Apr 2013 18:56:30 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 26638 invoked by uid 500); 9 Apr 2013 18:56:30 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 26629 invoked by uid 99); 9 Apr 2013 18:56:30 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Apr 2013 18:56:30 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of static.void.dev@gmail.com designates 209.85.160.53 as permitted sender) Received: from [209.85.160.53] (HELO mail-pb0-f53.google.com) (209.85.160.53) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Apr 2013 18:56:23 +0000 Received: by mail-pb0-f53.google.com with SMTP id un15so366043pbc.40 for ; Tue, 09 Apr 2013 11:56:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer; bh=78j+iHsIsptwqE6cx1AdSSKZEPHrH1w4KsTLSOab0aE=; b=eU/f04oPcUHJzmleHTyeYyzD9mZjsbR6IPTourIDaaXzCLehmngon+OYmttE3VIuJ+ Qr7k1aqmJDRue0eR2XPLk4ZasOQYppgE4PlK4dijxjkjTcPUyQ3wUsHTw5+86Gzc5vKE YfvMovYzV/elKHKfsj449paYJr4sDlrFQmriyObRzY4U0wi7PQLlDTfPHvfKb4B/mbfn HF4TaOSM7n3mLOKJ2XUiFuMmxD4rAcXxgtENoxG7GMB3E/VKDzNsM5KZU+Wmjkt92bqD ubyNYkoW94mIqOvSTxo+lns9q97Q9mx0fT/TThtnoOons6w2MocIoDs1izRtLu6rPtYL 91bw== X-Received: by 10.66.25.13 with SMTP id y13mr44834835paf.208.1365533763728; Tue, 09 Apr 2013 11:56:03 -0700 (PDT) Received: from [172.16.1.74] (206-15-64-66.static.twtelecom.net. [206.15.64.66]) by mx.google.com with ESMTPS id yr10sm47593180pab.6.2013.04.09.11.56.02 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 09 Apr 2013 11:56:02 -0700 (PDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: Best format to use From: Mark In-Reply-To: Date: Tue, 9 Apr 2013 11:56:00 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <13DEBBA9-9990-4217-9023-760431F5D367@gmail.com> References: <3F80E783-79EE-4D10-8E84-C5881B9D56EF@gmail.com> <09674432-2891-4729-979A-3E41D0A7F361@gmail.com> To: user@hadoop.apache.org X-Mailer: Apple Mail (2.1499) X-Virus-Checked: Checked by ClamAV on apache.org Avro is pretty sweet but is it supported by Hive, Pig and Impala. Is it = splittable? On Apr 9, 2013, at 10:58 AM, Roman Shaposhnik wrote: > On Tue, Apr 9, 2013 at 9:50 AM, Mark = wrote: >> Forgetting Impala, what format would be best to use with daily logs? >>=20 >> Block-compressed sequence files? >=20 > I'd actually use avro encoded files. >=20 > Thanks, > Roman.