From user-return-637-archive-asf-public=cust-asf.ponee.io@impala.apache.org Sun Feb 11 09:00:10 2018 Return-Path: X-Original-To: archive-asf-public@eu.ponee.io Delivered-To: archive-asf-public@eu.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by mx-eu-01.ponee.io (Postfix) with ESMTP id 6867C18064E for ; Sun, 11 Feb 2018 09:00:10 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 45B18160C4E; Sun, 11 Feb 2018 08:00:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 658F2160C36 for ; Sun, 11 Feb 2018 09:00:09 +0100 (CET) Received: (qmail 33887 invoked by uid 500); 11 Feb 2018 08:00:08 -0000 Mailing-List: contact user-help@impala.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@impala.apache.org Delivered-To: mailing list user@impala.apache.org Received: (qmail 33874 invoked by uid 99); 11 Feb 2018 08:00:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Feb 2018 08:00:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9B012C0096 for ; Sun, 11 Feb 2018 08:00:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.199 X-Spam-Level: * X-Spam-Status: No, score=1.199 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_SHORT=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=icloud.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id I1HkwiDVSxXh for ; Sun, 11 Feb 2018 08:00:04 +0000 (UTC) Received: from pv35p12im-ztdg05041101.me.com (pv35p12im-ztdg05041101.me.com [17.133.186.214]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 6E4675FACF for ; Sun, 11 Feb 2018 08:00:03 +0000 (UTC) Received: from process-dkim-sign-daemon.pv35p12im-ztdg05041101.me.com by pv35p12im-ztdg05041101.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) id <0P3Z00B007C2B400@pv35p12im-ztdg05041101.me.com> for user@impala.apache.org; Sun, 11 Feb 2018 07:59:56 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=04042017; t=1518335996; bh=6P85XUB6ul+KlTIXZq3ZSd+XswqOtYRtKq+wFxTp8RM=; h=From:Content-type:MIME-version:Subject:Date:To:Message-id; b=OXkU+WSGs7H/jb+3p9g4OslcqYg0RmQDRra5FWHigIA38wFtkuZdBXVKWa4Klz2dV bkkSE36VGWZ4LxT5dsoxnD2SUs1RdXjGbohEUCK3Na5VSLzS4T5qM/gsMA6mHtIncl Q7Glcp9SWPLqPZrKW2d5BDpAL7heibH6jyFHFdKee51Gcciwa+h2tRGszwUzv3f6U9 m64dNlTq55QclwO2pDDsRgsQBlAX3wv8hulZc83jFgOqSwSl56KDSyqoj+Lncas6wt /MDWn5tzWuopSBcoXFv5jApaL97+J14kMl4BN18VjNb43ArkTW2x8HkQTzwxQ7pXED sqzcMdxsABttw== Received: from icloud.com ([127.0.0.1]) by pv35p12im-ztdg05041101.me.com (Oracle Communications Messaging Server 8.0.1.2.20170607 64bit (built Jun 7 2017)) with ESMTPSA id <0P3Z006R17JSDW00@pv35p12im-ztdg05041101.me.com> for user@impala.apache.org; Sun, 11 Feb 2018 07:59:56 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2018-02-11_04:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1015 suspectscore=1 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1707230000 definitions=main-1802110107 From: Bruno Quinart Content-type: multipart/alternative; boundary="Apple-Mail=_28DE8928-5483-47FB-BABF-6FB4B19E45B5" MIME-version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: Removing "external data source" Date: Sun, 11 Feb 2018 08:59:52 +0100 References: To: user@impala.apache.org In-reply-to: Message-id: <36CA3C3D-7BDD-4C3B-B94F-643E16D8C8DF@icloud.com> X-Mailer: Apple Mail (2.3445.5.20) --Apple-Mail=_28DE8928-5483-47FB-BABF-6FB4B19E45B5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I don=E2=80=99t how the Impala external DataSource works. However, I am = familiar with how Netezza works with EXTERNAL TABLE and REMOTESOURCE. Efficient and easy data ingestion to Impala (via ODBC) is something our = R, Python and SAS users miss. You can get an idea at: = https://www.ibm.com/support/knowledgecenter/en/SSULQD_7.2.1/com.ibm.nz.loa= d.doc/t_load_loading_data_remote_client_sys.html = To ingest data today, users need to manage amongst others: Kerberos = authentication, hdfs data copy, hdfs access rights and Sentry url = privileges. =46rom subsequent discussion on this thread I understand what was done = will not help here. However, I wanted to highlight this use case so you = can still consider it in the future (in addition to access to = =E2=80=9Cinformation schema=E2=80=9D) and not close the "external = source=E2=80=9D case forever. > On 7 Feb 2018, at 05:47, Jim Apple wrote: >=20 > Is there an argument for documenting it and keeping it? Did it not = meet the need it was added for in the first place, or has that need = deceased in importance? >=20 > On Tue, Feb 6, 2018 at 7:29 PM Philip Zeyliger > wrote: > Hi folks, >=20 > I want to bring your attention to http://gerrit.cloudera.org:8080/9192 = , "IMPALA-6204: Remove external = DataSource". This is functionality that was never publicly documented = and, to my knowledge, is not in use by anyone. We'd like to remove it to = reduce complexity. >=20 > Please let me know if you've got concerns! >=20 > Thanks, >=20 > -- Philip --Apple-Mail=_28DE8928-5483-47FB-BABF-6FB4B19E45B5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 I = don=E2=80=99t how the Impala external DataSource works. However, I am = familiar with how Netezza works with EXTERNAL TABLE and = REMOTESOURCE.

Efficient and easy data ingestion to Impala (via ODBC) is = something our R, Python and SAS users miss.
You can = get an idea at:
= To ingest data today, users need to manage amongst others: Kerberos = authentication, hdfs data copy, hdfs access rights and Sentry url = privileges.

=46rom subsequent = discussion on this thread I understand what was done will not help here. = However, I wanted to highlight this use case so you can still consider = it in the future (in addition to access to =E2=80=9Cinformation = schema=E2=80=9D) and not close the "external source=E2=80=9D case = forever.


On 7 Feb 2018, at 05:47, Jim = Apple <jbapple@cloudera.com> wrote:

Is there an argument for documenting it and = keeping it? Did it not meet the need it was added for in the first = place, or has that need deceased in importance?

On Tue, Feb 6, 2018 at 7:29 PM = Philip Zeyliger <philip@cloudera.com> wrote:
Hi = folks,

I want to = bring your attention to http://gerrit.cloudera.org:8080/9192, "IMPALA-6204: = Remove external DataSource". This is functionality that was never = publicly documented and, to my knowledge, is not in use by anyone. We'd = like to remove it to reduce complexity.

Please let me know if you've got = concerns!

Thanks,

-- Philip

= --Apple-Mail=_28DE8928-5483-47FB-BABF-6FB4B19E45B5--