From user-return-210-archive-asf-public=cust-asf.ponee.io@arrow.apache.org Thu Oct 24 12:47:24 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 6444618065D for ; Thu, 24 Oct 2019 14:47:24 +0200 (CEST) Received: (qmail 32020 invoked by uid 500); 24 Oct 2019 12:47:23 -0000 Mailing-List: contact user-help@arrow.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@arrow.apache.org Delivered-To: mailing list user@arrow.apache.org Received: (qmail 32010 invoked by uid 99); 24 Oct 2019 12:47:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Oct 2019 12:47:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id E26741A40AC for ; Thu, 24 Oct 2019 12:47:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.236 X-Spam-Level: X-Spam-Status: No, score=0.236 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, HTML_MIME_NO_HTML_TAG=0.635, MIME_HTML_ONLY=0.3, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=yandex.ru Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 1MfhuBWxIeiG for ; Thu, 24 Oct 2019 12:47:19 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=77.88.28.100; helo=forward100p.mail.yandex.net; envelope-from=datagy@yandex.ru; receiver= Received: from forward100p.mail.yandex.net (forward100p.mail.yandex.net [77.88.28.100]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 739F07DDF3 for ; Thu, 24 Oct 2019 12:47:18 +0000 (UTC) Received: from mxback14o.mail.yandex.net (mxback14o.mail.yandex.net [IPv6:2a02:6b8:0:1a2d::65]) by forward100p.mail.yandex.net (Yandex) with ESMTP id C6AAA5982022 for ; Thu, 24 Oct 2019 15:47:10 +0300 (MSK) Received: from localhost (localhost [::1]) by mxback14o.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 85eLwag72k-lAvSxMpW; Thu, 24 Oct 2019 15:47:10 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1571921230; bh=Amv5306xMpvB8T1S+b/G6R8qMs7u8c+ZUBDfjrMozNM=; h=Message-Id:Date:Subject:To:From; b=U54fnYVpge1YiaS/KAcZZG7JBCwlh1uuhai+eB4STYiD5FZiJYgKaGIPtTY98XqG9 faEvV+juzwBweMlYnRwYJj0KGuEFv7p1A4n3ammRxJOqDmJMakkPsxw0BA1ny0E9km xNe/gAcFx6UQTbB06bkcZcFZC4JsvZcIO8aZ1NpQ= Authentication-Results: mxback14o.mail.yandex.net; dkim=pass header.i=@yandex.ru Received: by myt2-dd3598211d70.qloud-c.yandex.net with HTTP; Thu, 24 Oct 2019 15:47:10 +0300 From: Dima Fomin To: user@arrow.apache.org Subject: ArrowNotImplementedError: No cast implemented from decimal(2,2) to decimal(12,2) MIME-Version: 1.0 X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Thu, 24 Oct 2019 15:47:10 +0300 Message-Id: <17036451571921230@myt2-dd3598211d70.qloud-c.yandex.net> Content-Transfer-Encoding: 8bit Content-Type: text/html; charset=utf-8
Hello!
First of all thank you very much for your efforts on Apache Arrow! This looks very useful and prominent tech to be able use it in self-BI area.
 
I faced such issues - get Subj Error
ArrowNotImplementedError: No cast implemented from decimal(2,2) to decimal(12,2)
when trying to pyarrow.Table.from_batches array of values defined in schema as pyarrow.decimal128(12,2).
 
Which values are in fact column of sqlAlchemy.sql.sqltypes.DECIMAL()="DECIMAL(precision=12,scale=2)" values, which I map in schema like this pyarrow.decimal128(12,2).
 
What could be a reason of issue?
Could it be that somehow declared decimal type of data is reduced to minimum value which met in data? :/
 
With best regards,
Dima Fomin