Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0D616200CFE for ; Fri, 8 Sep 2017 10:28:14 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0C1D51609C0; Fri, 8 Sep 2017 08:28:14 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 2C9571609BF for ; Fri, 8 Sep 2017 10:28:13 +0200 (CEST) Received: (qmail 94780 invoked by uid 500); 8 Sep 2017 08:28:11 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 94770 invoked by uid 99); 8 Sep 2017 08:28:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Sep 2017 08:28:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2A45518F486 for ; Fri, 8 Sep 2017 08:28:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 9Nt7xwPo4iqA for ; Fri, 8 Sep 2017 08:28:06 +0000 (UTC) Received: from mail-ua0-f181.google.com (mail-ua0-f181.google.com [209.85.217.181]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id D0D6D5FCB9 for ; Fri, 8 Sep 2017 08:28:05 +0000 (UTC) Received: by mail-ua0-f181.google.com with SMTP id q29so3076485uaf.3 for ; Fri, 08 Sep 2017 01:28:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=sOcJamJq9uzN+X/uySEb1cEiwKE3yWqzX0TdmegEZN0=; b=hD0DmctiwFu+NDrngHslS+7r/yId9eMAzQb69qxgS6vJj9tRVtDdy2J+NPq9b8cjv2 j+yoI2sbgS85biMDMZPE13QZUY9sV/7+VPOe1HlEPDoQbNmsGeZFdBRGG8LwLhgQH3Fa IVMFaw7/uMS3OB11lWY90C5ggFFBOGtHOjG7hxRmTdxM14/AqkKYA+bzh6KmeivX8lIb sH7OhBJSZnb5sI7fKuEPIxy9DFzd3NQ6JqR+QW0wZmZ0Pl00ShiSTqUs78NAtL0xBYKl S2RdJL9G7zo1Uj2Ep0f2w3dNITp/IVT/HTnAa8ft0olFyAS2navBLd2H+7q+KhOKvRZm s67A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=sOcJamJq9uzN+X/uySEb1cEiwKE3yWqzX0TdmegEZN0=; b=rpXPEG9L0M0RYnVXDk+fmW271odK2q6mB+rVbetpHcNhAdgLdQ8joLwTBwHPgIfwvg VmDEtCJ6uT1HtQSQHAm2lrINUkdzxAeRyTmnWEBXpXHzYpl/2AzIsJYBv9/AT6sYkYxT USom1NSAsy2RWaBEdUnCBkvhhw0vdV8R5DmLUvhVufwOwikuRoae9d9DzRb6wIBI8Zc6 kBWeJ3P8jM6L2snQINxKp6c4WuShI2rg0psyXRdYL7eNOT/F3UV28mP46Cv/1LDD9Vef UNie3EcX2uECScTR0lnLWAyerwjBd0Q3ttTYCTAFzNT1RIIRKhPgUvrN93rikxlFIB5i F7/g== X-Gm-Message-State: AHPjjUio/4hUpudncUUjpsRoHBD9IR+66HS7ZA5ABBBV0bNQ1KzqfzWX MKvp/4vJKJ0tgXP2210Qu05MFCi9aw== X-Google-Smtp-Source: AOwi7QAc1lCHxBPeOmQyudFoxwbf28+edgg57MIbee2WWq6rVZyvzFrPh8Vr5UN3NSxeewK7hFAM8GFo6SxhqSKPY1w= X-Received: by 10.176.17.88 with SMTP id g24mr1295859uac.26.1504859285460; Fri, 08 Sep 2017 01:28:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.56.201 with HTTP; Fri, 8 Sep 2017 01:27:35 -0700 (PDT) In-Reply-To: References: From: Fabian Hueske Date: Fri, 8 Sep 2017 10:27:35 +0200 Message-ID: Subject: Re: Does Flink has a JDBC server where I can submit Calcite Streaming Queries? To: kant kodali Cc: user Content-Type: multipart/alternative; boundary="f4030435b560259bf80558a95bda" archived-at: Fri, 08 Sep 2017 08:28:14 -0000 --f4030435b560259bf80558a95bda Content-Type: text/plain; charset="UTF-8" As I said, there is no such functionality built into Flink yet. A client program can be parameterized with a query and turned into a SQL client that way. The submission would work with the regular Flink job client, i.e., it would pickup the regular Flink config. Best, Fabian 2017-09-08 10:05 GMT+02:00 kant kodali : > Hi Fabian, > > Thanks for the response. I understand the common approach is to write a > client program and run it however this will not allow me to send queries > Ad-hoc so Is there anyway for me to submit Calcite SQL to Flink via REST or > whatever mechanism? Forgot even, the result set once I know there is a way > to submit Adhoc queries I can figure out a way to write to Kafka. > > Thanks, > kant > > On Fri, Sep 8, 2017 at 12:52 AM, Fabian Hueske wrote: > >> Hi Kant, >> >> no, there is no such functionality. >> I'm also not sure how well streaming would work together with the JDBC >> interface. JDBC has not been designed for continuous streaming queries, >> i.e., queries that never terminate. >> Challenges would be to have an infinite, streamable ResultSet (which >> might be possible) and how to represent retractions, i.e., updates of >> previously emitted results (I doubt this would work). >> >> If a streamable ResultSet was possible, a subset of queries (those that >> only produce new rows and never have to update emitted results) could be >> supported. >> >> Right now, the approach would be to implement a client program that >> executes queries and writes their result to a destination like Kafka or a >> database using a TableSink [1]. >> The community is also discussing a SQL client to submits queries. [2] >> >> Best, Fabian >> >> [1] https://ci.apache.org/projects/flink/flink-docs-release-1.3/ >> dev/table/sourceSinks.html >> [2] https://issues.apache.org/jira/browse/FLINK-7594 >> >> >> 2017-09-07 21:43 GMT+02:00 kant kodali : >> >>> Hi All, >>> >>> Does Flink has a JDBC server where I can submit Calcite Streaming >>> Queries? such that I get Stream of responses back from Flink forever via >>> JDBC ? What is the standard way to do this? >>> >>> Thanks, >>> Kant >>> >> >> > --f4030435b560259bf80558a95bda Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
As I said, there is no such functionality built = into Flink yet.

A client program can be parameteriz= ed with a query and turned into a SQL client that way.
The s= ubmission would work with the regular Flink job client, i.e., it would pick= up the regular Flink config.

Best, Fabian

2017-09-08= 10:05 GMT+02:00 kant kodali <kanth909@gmail.com>:
Hi Fabian,

Th= anks for the response. I understand the common approach is to write a clien= t program and run it however this will not allow me to send queries Ad-hoc = so Is there anyway for me to submit Calcite SQL to Flink via REST or whatev= er mechanism? Forgot even, the result set once I know there is a way to sub= mit Adhoc queries I can figure out a way to write to Kafka.

<= /div>
Thanks,
kant

On Fri, = Sep 8, 2017 at 12:52 AM, Fabian Hueske <fhueske@gmail.com> w= rote:
Hi Kant,

no, there is no such functionality.
= I'm also not sure how well streaming would work together with the JDBC = interface. JDBC has not been designed for continuous streaming queries, i.e= ., queries that never terminate.
Challenges would be to have an in= finite, streamable ResultSet (which might be possible) and how to represent= retractions, i.e., updates of previously emitted results (I doubt this wou= ld work).

If a streamable ResultSet was possible, a subset of = queries (those that only produce new rows and never have to update emitted = results) could be supported.

Right now, the ap= proach would be to implement a client program that executes queries and wri= tes their result to a destination like Kafka or a database using a TableSin= k [1].
The community is also discussing a SQL client to submits q= ueries. [2]

Best, Fabian

[1] https://ci.apache.org/projects/flink/flink-= docs-release-1.3/dev/table/sourceSinks.html
[2] https://iss= ues.apache.org/jira/browse/FLINK-7594


2017-09-07 21:= 43 GMT+02:00 kant kodali <kanth909@gmail.com>:
Hi All,

Does Flin= k has a JDBC server where I can submit Calcite Streaming Queries? such that= I get Stream of responses back from Flink forever via JDBC ? What is the s= tandard way to do this?

Thanks,
Kant=



--f4030435b560259bf80558a95bda--