Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7FA57102E6 for ; Thu, 10 Oct 2013 13:14:54 +0000 (UTC) Received: (qmail 67725 invoked by uid 500); 10 Oct 2013 13:14:45 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 67644 invoked by uid 500); 10 Oct 2013 13:14:44 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 67630 invoked by uid 99); 10 Oct 2013 13:14:42 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Oct 2013 13:14:42 +0000 X-ASF-Spam-Status: No, hits=3.1 required=5.0 tests=HTML_IMAGE_ONLY_12,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_REMOTE_IMAGE X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dsuiter@rdx.com designates 209.85.212.180 as permitted sender) Received: from [209.85.212.180] (HELO mail-wi0-f180.google.com) (209.85.212.180) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Oct 2013 13:14:36 +0000 Received: by mail-wi0-f180.google.com with SMTP id hj8so2341843wib.1 for ; Thu, 10 Oct 2013 06:14:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rdx.com; s=google; h=mime-version:date:message-id:subject:from:to:content-type; bh=oICk9hjlWwWRPyNyJASQpzzDYecx+J09ccIFdhZ7Iqg=; b=YcSsaCXmwwa0LC9app2Jj/0PkdYX4TtyN9R9ZZnagsHJ7B/Iq6BssqRcEXyIr4COgL 41wWzRJK7AKButVXsrR5memQKDP4Oc0Vj+lrmRiyTjYdZ3HJPQpuNfXvmveFMmtnukcU lN+8FvLZ283IcwSOdWZ/8VoQ3ezG/4dty4vtw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=oICk9hjlWwWRPyNyJASQpzzDYecx+J09ccIFdhZ7Iqg=; b=f8nZB2UqW4ZY6o5G7PzQZ5k1+1m1C81IMT7pvd8DBhCQ/UiasMCVm4Zvdaui4Ak1AP WjlLFGVQ6AVs4sIagnm1+4ALjXcmwfFzg89J2xaew65m05odut74JwPYk1VMIzoO9k8P FM8H1B7gKeQ60HEIRPXvlPFlJu5yQZsXXsr6PURQC6jqGAdw7KuKaIeFp7/UYlxSrYVJ n1qFmNArsNQHZHqAseFh20f8BqncOfad9GTYLY5RV1eATIcI4rUR2nX+6gbosSnPsU+Y clEVNHgSxB6WCj5lG0nuDMmHZDHZOTSNOPwr5v2UTfToCqlDdKtVYCUxANWP3630bdH7 9MTw== X-Gm-Message-State: ALoCoQlVRiKye4ZsMuZgMBg+Swq4IG2DDX5jCD85cG9wY0kHL8xZJ2pYtLTO7eKmZLGW41b/Q1e6 MIME-Version: 1.0 X-Received: by 10.195.13.164 with SMTP id ez4mr12253927wjd.11.1381410856552; Thu, 10 Oct 2013 06:14:16 -0700 (PDT) Received: by 10.216.52.134 with HTTP; Thu, 10 Oct 2013 06:14:16 -0700 (PDT) Date: Thu, 10 Oct 2013 09:14:16 -0400 Message-ID: Subject: Read Avro schema automatically? From: DSuiter RDX To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bb04f6864e87804e862c77f X-Virus-Checked: Checked by ClamAV on apache.org --047d7bb04f6864e87804e862c77f Content-Type: text/plain; charset=ISO-8859-1 Hi, We are working on building a MapReduce program that takes Avro input from HDFS, gets the timestamp, and counts the number of events written in any given day. We would like to make a program that does not need to have the Avro data declared previously, rather, it would be best if it could read the schema, determine the data type from the schema, and assign it for the mapper. Is this possible? *Devin Suiter* Jr. Data Solutions Software Engineer 100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212 Google Voice: 412-256-8556 | www.rdx.com --047d7bb04f6864e87804e862c77f Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

We are working on buildi= ng a MapReduce program that takes Avro input from HDFS, gets the timestamp,= and counts the number of events written in any given day. We would like to= make a program that does not need to have the Avro data declared previousl= y, rather, it would be best if it could read the schema, determine the data= type from the schema, and assign it for the mapper. Is this possible?
Devin Suiter
Jr. Da= ta Solutions Software Engineer
100 Sandusky Street | 2nd = Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 |=A0www.rdx.com
--047d7bb04f6864e87804e862c77f--