From dev-return-35621-archive-asf-public=cust-asf.ponee.io@sqoop.apache.org Wed Feb 14 15:01:03 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6CB02180656 for ; Wed, 14 Feb 2018 15:01:03 +0100 (CET) Received: (qmail 56857 invoked by uid 500); 14 Feb 2018 14:01:02 -0000 Mailing-List: contact dev-help@sqoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@sqoop.apache.org Delivered-To: mailing list dev@sqoop.apache.org Received: (qmail 56846 invoked by uid 99); 14 Feb 2018 14:01:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 14 Feb 2018 14:01:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 14D8E1A0668 for ; Wed, 14 Feb 2018 14:01:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -102.311 X-Spam-Level: X-Spam-Status: No, score=-102.311 tagged_above=-999 required=6.31 tests=[RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id tsLw_6WlO-aE for ; Wed, 14 Feb 2018 14:01:01 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id E733D5F576 for ; Wed, 14 Feb 2018 14:01:00 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 74C19E026D for ; Wed, 14 Feb 2018 14:01:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 308C4240FA for ; Wed, 14 Feb 2018 14:01:00 +0000 (UTC) Date: Wed, 14 Feb 2018 14:01:00 +0000 (UTC) From: "Ferenc Szabo (JIRA)" To: dev@sqoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (SQOOP-2976) Flag to expand decimal values to fit AVRO schema MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/SQOOP-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Szabo updated SQOOP-2976: -------------------------------- Attachment: SQOOP-2976.patch > Flag to expand decimal values to fit AVRO schema > ------------------------------------------------ > > Key: SQOOP-2976 > URL: https://issues.apache.org/jira/browse/SQOOP-2976 > Project: Sqoop > Issue Type: Improvement > Affects Versions: 1.4.6 > Reporter: Thomas Scott > Assignee: Ferenc Szabo > Priority: Major > Attachments: SQOOP-2976.patch, SQOOP-2976.patch > > > As per https://issues.apache.org/jira/browse/AVRO-1864 when importing from Oracle (or any other database that truncates decimals) Sqoop jobs can fail because the scale of the decimal produced by the database does not match the scale in the AVRO file. > For instance if the value 3.15 is produced by Oracle and the AVRO decimal scale is 3 (this can happen even if the Oracle column is defined with scale of 3) then the job will fail. > Can we have a flag (--pad-decimals) that pads incoming values with zeros to fit the AVRO schema (e.g. 3.15 becomes 3.150). -- This message was sent by Atlassian JIRA (v7.6.3#76005)