Return-Path: X-Original-To: apmail-nifi-users-archive@minotaur.apache.org Delivered-To: apmail-nifi-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4A8A619321 for ; Fri, 4 Mar 2016 18:57:35 +0000 (UTC) Received: (qmail 9233 invoked by uid 500); 4 Mar 2016 18:57:35 -0000 Delivered-To: apmail-nifi-users-archive@nifi.apache.org Received: (qmail 9206 invoked by uid 500); 4 Mar 2016 18:57:35 -0000 Mailing-List: contact users-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@nifi.apache.org Delivered-To: mailing list users@nifi.apache.org Received: (qmail 9196 invoked by uid 99); 4 Mar 2016 18:57:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2016 18:57:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id AD4731806AD for ; Fri, 4 Mar 2016 18:57:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.879 X-Spam-Level: X-Spam-Status: No, score=0.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_REPLY=1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id wX2Cxu_ROvO5 for ; Fri, 4 Mar 2016 18:57:33 +0000 (UTC) Received: from mail-yw0-f175.google.com (mail-yw0-f175.google.com [209.85.161.175]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BB3025F640 for ; Fri, 4 Mar 2016 18:57:32 +0000 (UTC) Received: by mail-yw0-f175.google.com with SMTP id i131so38531763ywc.3 for ; Fri, 04 Mar 2016 10:57:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-transfer-encoding; bh=wIBEr0di2NJp3Zhm3elTdm1aONCFgQKJADKHJfgHN2M=; b=gYe7M9KUUCBgJZLMnyPvnP9vP3e8cPoqq7V0Ezvxe6zZ0j+ZAhp0BAF6WbXXxucOji r3fLR39ZPQguNSSzPG6BDNNgeKKoZ+8emMvVoX576uXDuD2Xw5PhjI5ycrM+2pH/eGJg AQxpDASc5332j173bgl+GwazvOaiWp+JBr8OwmuxtScCDNFVtfP1qlR1AR/HJ9lnU3LP w+yNB2lGwFx6TiuZVgcJtlh2bRaf23Ui1Q1sC0HSHzIDGHPnn85YhozSDiWaTwSQnRoe ec8YISh1SdQCLp9qtfSgZPQDzchXg8e3bKi80YFaz9OxQBylO1GuSLLGv/u4aQqtY1ip iCDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-transfer-encoding; bh=wIBEr0di2NJp3Zhm3elTdm1aONCFgQKJADKHJfgHN2M=; b=NBTdkIUA2Rebf4zISSv9mijHmx/Um42NTnUvAlgJST+qbQX0hIyY8cquhuULTsUlcv H8QMtGMzlhv11OsFJB73yWPWRRXdjIxo0rgNRkS5rjlUxXW+QEk8jQpCubbRFo1R6WXT +LMYiEr0zINC7Ztj7xfie3tBQ1jvIh95mqs+SZ6Gtiz2r/cPBtUWbjXDEzp8x3lhIVDx sVW3GiK/0PtzaU/tmUgxThMTIn6KK4B58o/bYhnDoYh5AV6eY/c0nVpgCnkJY0tDvCjH ciu1nyZvbP+LrDEHf+lOD93YbsUGg1S/jKymcwaYt8DGPvONdYjQsAFyHjDaKVmXHeo7 zuog== X-Gm-Message-State: AD7BkJI9KzSEBNoBpzyl0UKDVrXHbK6Q3gRIaASLDHnnBbAGpksUI+vzVAuY6KdNcUA5yKjUU2brkOFBvA5SuA== MIME-Version: 1.0 X-Received: by 10.129.76.17 with SMTP id z17mr5267981ywa.191.1457117851807; Fri, 04 Mar 2016 10:57:31 -0800 (PST) Received: by 10.37.214.208 with HTTP; Fri, 4 Mar 2016 10:57:31 -0800 (PST) In-Reply-To: References: <678440313.2845936.1457107230136.JavaMail.yahoo@mail.yahoo.com> Date: Fri, 4 Mar 2016 13:57:31 -0500 Message-ID: Subject: Re: Re: List Files From: Joe Witt To: users@nifi.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Charlie, Yeah you're right that is a viable option now too. And we support environment variables from the system too. So for things that support expression language that helps. The variable registry obviously will give us a nice step forward. Thanks Joe On Fri, Mar 4, 2016 at 1:55 PM, Charlie Frasure wrote: > Thanks Joe, > > That option is certainly more comprehensive than what I was looking to do= . > An UpdateAttribute at the beginning of a flow (or even before a process > group) could establish the variables I need. One case that either > UpdateAttribute or the Variable Registry should consider is being able to > mark sensitive properties so that things like passwords can remain secure= . > > > On Fri, Mar 4, 2016 at 1:24 PM, Joe Witt wrote: >> >> No. But we need to and plan to >> https://cwiki.apache.org/confluence/display/NIFI/Variable+Registry >> >> On Fri, Mar 4, 2016 at 1:22 PM, Uwe Geercken wrote= : >> > Matthew, >> > >> > does NiFi itself allow to define such things as constants? The idea >> > would be >> > to re-use these constants (e.g. a path) in different processors. >> > >> > Rgds, >> > >> > Uwe >> > >> > Gesendet: Freitag, 04. M=C3=A4rz 2016 um 19:04 Uhr >> > Von: "Matthew Clarke" >> > An: users@nifi.apache.org, "Joe Percivall" >> > Betreff: Re: List Files >> > >> > The expression language can also be used to return values from both JV= M >> > properties set in the NiFi bootstrap.conf and system environment >> > variables >> > for the user running NiFi. >> > >> > On Mar 4, 2016 11:00 AM, "Joe Percivall" wrot= e: >> >> >> >> Hello, >> >> >> >> ListFile is a source processor so this behavior is expected. It >> >> supports >> >> expression language so that it can be configured to utilize certains >> >> methods. For example, some people may want to get a list of files fro= m >> >> a >> >> rotating directory that gets created every hour. To do that they woul= d >> >> need >> >> to use the date functions included in Expression Language. >> >> >> >> Does forbidding input hinder a specific use-case you have? >> >> >> >> Joe >> >> >> >> - - - - - - >> >> Joseph Percivall >> >> linkedin.com/in/Percivall >> >> e: joepercivall@yahoo.com >> >> >> >> >> >> >> >> On Friday, March 4, 2016 10:38 AM, Charlie Frasure >> >> wrote: >> >> >> >> >> >> >> >> I'm using the 0.5.1 build and having what I think is odd behavior for >> >> ListFile. The processor supports expression language in the Input >> >> Directory >> >> property, however I can't figure out how to configure an attribute as >> >> input. >> >> >> >> I tried using UpdateAttribute prior to ListFile, but ListFile doesn't >> >> seem >> >> to allow incoming connections. I also tried creating an attribute >> >> within >> >> ListFile, but it doesn't seem to be available for referencing within >> >> the >> >> same processor. >> >> >> >> Is this expected? If so, what is the intended purpose of allowing >> >> expression language in this attribute? > >