Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E4388200AC8 for ; Mon, 23 May 2016 23:32:17 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id E2D71160A0E; Mon, 23 May 2016 21:32:17 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 38BE8160A24 for ; Mon, 23 May 2016 23:32:17 +0200 (CEST) Received: (qmail 84719 invoked by uid 500); 23 May 2016 21:32:16 -0000 Mailing-List: contact dev-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.apache.org Delivered-To: mailing list dev@apex.apache.org Received: (qmail 84467 invoked by uid 99); 23 May 2016 21:32:16 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 May 2016 21:32:16 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id A5FDCC14B9 for ; Mon, 23 May 2016 21:32:15 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.298 X-Spam-Level: * X-Spam-Status: No, score=1.298 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=datatorrent-com.20150623.gappssmtp.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id zZdC6eIaaNZL for ; Mon, 23 May 2016 21:32:13 +0000 (UTC) Received: from mail-pf0-f179.google.com (mail-pf0-f179.google.com [209.85.192.179]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 035225F343 for ; Mon, 23 May 2016 21:32:12 +0000 (UTC) Received: by mail-pf0-f179.google.com with SMTP id y69so68427880pfb.1 for ; Mon, 23 May 2016 14:32:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=datatorrent-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=hFCo+v2+UQMKskcZOzzxSoumVnVmT91/KBwIgIDnefM=; b=KpuaS8pHRAk5u6Wr4M73CylfL7fnc7dH6YwRwpznmNjq81ycoUDclkCFX5QUUN7eO6 RXdipGhObVhuM46D23msQfPrZKlYxfztnE9kXTphMDxjZ7NETlz1whlTMZoamTiB8yg2 2miSbd/XQREMIwq0ka3anvZPjfP3fd54LqN/IboCzOvUZIx3+cy8PVT8lPYWA+Ob5NEA rtd0KVRxHFHsv8AEDJDrKPVIsm8nT6jLHG8n2FQn28rnbRnqr9PbDyAy8WZHxPS2QJyN DUUsEulbNpk9Ti1+zjJHXAA7vdOW7f1tNQrOKd9lOBqR3IPCcmz1Jbx85Xo/rH1TWeAJ BU1g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=hFCo+v2+UQMKskcZOzzxSoumVnVmT91/KBwIgIDnefM=; b=IcKMtzlt4UmbqH0WYLGnVRb0N3+Ok966Z0rNGuGaInJv5IGWh6H38UaCaPrNs8RaZw sAQ/5MBoWAE3ReLwK6ded5xDmszbHeWyZ/FyJrQFswuypPELVc+7ibLeUPCRMf0MJVMz qWsHcm0s8lxH4eVi5UvUZfJb/TDvd4f+7AUozGXnMRSpPw4T0rVvOqdPM+R8jiGfFLAg xHEgSxJImaqabFZnFKR87LjWMUouwYba3SaY4fT0mhNeXSfaPwCJi0dNdtaxWNCbuQPW HFl3aIzY9cC8fntv4LrtXiUq+pBfMJVPTIVOwbbpPgnbv6crZ7fneHgm/O8LLfAcvQr8 RrCw== X-Gm-Message-State: ALyK8tLF/V9O/ZVrDmHDiruOBHTk7hSgsG7/IxwtcacPE3kgQjUZhecJjkpTabS6L3qi2J29ulwQuKDMl9bGewcc MIME-Version: 1.0 X-Received: by 10.98.84.65 with SMTP id i62mr1405246pfb.97.1464039131775; Mon, 23 May 2016 14:32:11 -0700 (PDT) Received: by 10.66.12.103 with HTTP; Mon, 23 May 2016 14:32:11 -0700 (PDT) In-Reply-To: References: Date: Mon, 23 May 2016 14:32:11 -0700 Message-ID: Subject: Re: Time controlled ingestion operator From: Priyanka Gugale To: users@apex.apache.org Cc: "dev@apex.apache.org" , "users@apex.incubator.apache.org" , "dev@apex.incubator.apache.org" Content-Type: multipart/alternative; boundary=94eb2c0cded6631a0a0533892c18 archived-at: Mon, 23 May 2016 21:32:18 -0000 --94eb2c0cded6631a0a0533892c18 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Sunil, I don't think we have exactly pause and resume feature in Malhar yet. But I can think of some other way to achieve this. We are adding bandwidth control feature to Malhar. The pull request is already opened for the same. This doesn't have option to configure timed bandwidth consumption (i.e. use x bandwidth during given time hours), but I think it's easy to do that in BandwidthManager. Or quick thing is you can try to update the property "bandwidth" during the time when u don't want operator to work using some external script (this is short term solution). Can you tell the reason why you want to pause the read during certain time hours? -Priyanka On Mon, May 23, 2016 at 2:21 PM, Sunil Parmar wrote: > All, > We=E2=80=99re writing an app for migration data from legacy JDBC system t= o Kafka. > Legacy system as it is still being used in production, we would want to > pause the JDBC poll input operator for configured hours. > > Does malhar ibrary has any operator that we can use for time controlled > operator ? > Or is there a way to configure input operators to pause and resume for > given time ? > > -Sunil > > > --94eb2c0cded6631a0a0533892c18--