Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DB3AC10851 for ; Wed, 21 Jan 2015 10:47:44 +0000 (UTC) Received: (qmail 20226 invoked by uid 500); 21 Jan 2015 10:47:44 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 20156 invoked by uid 500); 21 Jan 2015 10:47:44 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 20146 invoked by uid 99); 21 Jan 2015 10:47:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Jan 2015 10:47:44 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [209.85.213.53] (HELO mail-yh0-f53.google.com) (209.85.213.53) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Jan 2015 10:47:38 +0000 Received: by mail-yh0-f53.google.com with SMTP id v1so6458491yhn.12 for ; Wed, 21 Jan 2015 02:45:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-type; bh=oGvEqVCRKpazCaFnnBDjQacFtO6Wfl3qYwiubbxaKM0=; b=S1NSpajkUqgl1Qx/TiFySn9tnjnmMfWcJT3+NCsNM6cGwwXji2sAatK+jNVABbwQHj ga23yWxBZVWiNHSgYv8rWv3cgRNMzhHeZ+v1CPC0dfBF/EcssTlOfRWcXOMBOGyOJHLU fUrmwp6IkE6t/qFW6tIYNc6iT/3vxDpggaE/BJqFzLmsrki14DvH88yGG82ivzUhG7v6 5e0l3EWJ6dxvSqbGwwt7tflOzfww8ZVEFUQ+5IQK2sFvitE9sxfEXDMWUpez0geyHk5V ltlUkdAYsi6nw1rNJSAH1r32OKAGoa99+za4g3/k3xDs8CoLOZpsCn87/APsNW0xyD+f 28oQ== X-Gm-Message-State: ALoCoQkkDcZ095kaTN/2RSvHykV6uvFrd1GJp0sn9DdApH7TMcz78ZqV9t9MUnBI9EhUzjnOVGca X-Received: by 10.236.50.161 with SMTP id z21mr1661977yhb.18.1421837125464; Wed, 21 Jan 2015 02:45:25 -0800 (PST) MIME-Version: 1.0 Received: by 10.170.219.10 with HTTP; Wed, 21 Jan 2015 02:45:05 -0800 (PST) X-Originating-IP: [213.203.177.29] From: Flavio Pompermaier Date: Wed, 21 Jan 2015 11:45:05 +0100 Message-ID: Subject: Runtime generated (source) datasets To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a11c1d97ecada17050d2740f6 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1d97ecada17050d2740f6 Content-Type: text/plain; charset=UTF-8 Hi guys, I have a big question for you about how Fling handles job's plan generation: let's suppose that I want to write a job that takes as input a description of a set of datasets that I want to work on (for example a csv file and its path, 2 hbase tables, 1 parquet directory and its path, etc). >From what I know Flink generates the job's plan at compile time, so I was wondering whether this is possible right now or not.. Thanks in advance, Flavio --001a11c1d97ecada17050d2740f6 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi guys,

I have a big question for you about how Fling handles job's plan g= eneration:
let's suppose that I want to write a job that take= s as input a description of a set of datasets that I want to work on (for e= xample a csv file and its path, 2 hbase tables, 1 parquet directory and its= path, etc).=C2=A0
From what I know Flink generates the job's= plan at compile time, so I was wondering whether this is possible right no= w or not..

Thanks in advance,
Flavio
--001a11c1d97ecada17050d2740f6--