Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 53B15200AC0 for ; Tue, 10 May 2016 02:58:48 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 30D27160A0F; Tue, 10 May 2016 00:58:48 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7AA081609A8 for ; Tue, 10 May 2016 02:58:47 +0200 (CEST) Received: (qmail 78421 invoked by uid 500); 10 May 2016 00:58:46 -0000 Mailing-List: contact user-help@avro.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@avro.apache.org Delivered-To: mailing list user@avro.apache.org Received: (qmail 78411 invoked by uid 99); 10 May 2016 00:58:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 May 2016 00:58:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 27543C0DF7 for ; Tue, 10 May 2016 00:58:46 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.721 X-Spam-Level: X-Spam-Status: No, score=-0.721 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=cloudera-com.20150623.gappssmtp.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id wSP7_k20qK6z for ; Tue, 10 May 2016 00:58:42 +0000 (UTC) Received: from mail-lf0-f49.google.com (mail-lf0-f49.google.com [209.85.215.49]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 9F8B55F23A for ; Tue, 10 May 2016 00:58:41 +0000 (UTC) Received: by mail-lf0-f49.google.com with SMTP id j8so218008479lfd.2 for ; Mon, 09 May 2016 17:58:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudera-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=kU7Hr2rkvFiIcai78kJJZUMGo6EYl8EBpk3QE3G4LnY=; b=SLSiARZOxeMB22o4G4lPgVH4C4Do76yiiYiul0s7ZXwZH4DwGTRU4AfE2EI4grrYCa Gp/IwyqPcbUHl6fNRK0IBtyVKubF5D0/QGgYaTYi1vuKoK2Qlo3Bk8yluLAE5GTtNgss Acr7ND2Nmt0rStLXTob32O3TOEE4Bgk6wVOjR7vN0azfYbiBJOJdgft/XhIGOggexhmP TjpAMgE9k+EuoqWdOEmGrUpP6NBwJ84KvC7OWOalyDP/8iFBHMWCBf+BLK6EqDn9LqnQ NwFKBOOzRLIekfWTz8jnjrLKUA2XeqXb7bLymSdG8M7TrGxHvHXN+PEUxA1mdGcpnMnF Zk5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=kU7Hr2rkvFiIcai78kJJZUMGo6EYl8EBpk3QE3G4LnY=; b=SgDHfEzoiuIh24aGdicl5/I1Y06icKuEddNGnp36h4CMtZxCXE7FH2EoF7z+rAceif BcXAY1BfEXtratuTj/4mE0UhUnNgC7xUphzeb+DbUVgBjpawy5f7qcWe1zMHqfr9DRba xdNlTHP5mORMtgMO4kTOzYrcGjcPu2KVJ+wPNKka3YGhtqziDLEeef8cwSxgcLjP8ihK 24mSq1jQvtezMq9pkXv8/dLuTtCUfwZSIGXWK1khMBc8e0dTfPG+B9AsPK0oqsK53Ytr xrhlcmarDawgUyu0m1GsemZGFpWDe2iIxQbXClS5ao3EPKMX0bGawpJYRyvf/rmXmy72 ogOQ== X-Gm-Message-State: AOPr4FVUIQ0o8yjAc+sEvrlUZouA3sWwXYk5vr1Tf9h7GGzEPtVbLPgWX1UvPtEW/+QvzqcWs1Q5Wiy79+Uj9P14 X-Received: by 10.112.146.164 with SMTP id td4mr15604765lbb.82.1462841919260; Mon, 09 May 2016 17:58:39 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.138.193 with HTTP; Mon, 9 May 2016 17:58:19 -0700 (PDT) In-Reply-To: References: From: Sean Busbey Date: Mon, 9 May 2016 19:58:19 -0500 Message-ID: Subject: Re: is this an appropirate Avro use case? To: "user@avro apache. org" Content-Type: text/plain; charset=UTF-8 archived-at: Tue, 10 May 2016 00:58:48 -0000 On Mon, May 9, 2016 at 12:21 PM, Koert Kuipers wrote: > you cannot use avro to ensure the data comes in the format you expect (the > negative numbers issue). you will have to parse these variations before > converting to avro. Unless, of course, you can get the folks sending you data to agree to send it in Avro. If you specifically get them to send the numbers coded as one of the number types in Avro (rather than i.e. a string), you'd be able to parse it the same way all of the time. -- busbey