Return-Path: 
 <dev-return-17328-apmail-falcon-dev-archive=falcon.apache.org@falcon.apache.org>
X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org
Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 6D8101866C
	for <apmail-falcon-dev-archive@minotaur.apache.org>;
 Fri, 27 Nov 2015 01:50:50 +0000 (UTC)
Received: (qmail 92517 invoked by uid 500); 27 Nov 2015 01:50:50 -0000
Delivered-To: apmail-falcon-dev-archive@falcon.apache.org
Received: (qmail 92466 invoked by uid 500); 27 Nov 2015 01:50:50 -0000
Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@falcon.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@falcon.apache.org>
List-Post: <mailto:dev@falcon.apache.org>
List-Id: <dev.falcon.apache.org>
Reply-To: dev@falcon.apache.org
Delivered-To: mailing list dev@falcon.apache.org
Delivered-To: moderator for dev@falcon.apache.org
Received: (qmail 29055 invoked by uid 99); 26 Nov 2015 15:24:36 -0000
X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 3.129
X-Spam-Level: ***
X-Spam-Status: No, score=3.129 tagged_above=-999 required=6.31
	tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
	FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=3,
	RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001]
	autolearn=disabled
Authentication-Results: spamd2-us-west.apache.org (amavisd-new);
	dkim=pass (2048-bit key) header.d=gmail.com
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:date:message-id:subject:from:to:content-type;
        bh=2lt9qK5MmyA5sRMkV5NDqzt4pNUPZ573oAbP8/+NJcI=;
        b=ojhA5OcDMx1eZlm+U0QpWXtjKkAtq9e58SO2GUqK+kkkni9az2yYHLxnX8i7aEI32J
         eJXlKJjKgxMFYtnmuBFTzQ0bDZU/U2gn2ZNviCoZtHO3eRmzWZ2TFZxrCrGRwLH/jbXs
         VOQzV97b7KYjcJ9O0p0ISMbDd+I5V1bDSEW3DWtZFRE/TvNfEDwAPH1f+qlq1VVOPx2y
         0dh4/cU24bBg6XfC/eQWMeQaQRvvhyWl5aWBlm+hHK3LgwKOmhU1Yjpw9Dd/M34SE9J5
         SqoKkt12fULIaExv3DV0ybTNYIRZrCwdTu4sPUq+9yta1OOm3/7dxNtFYa83E8KsJ0VG
         +98A==
MIME-Version: 1.0
X-Received: by 10.129.159.201 with SMTP id w192mr4757865ywg.70.1448551473742;
 Thu, 26 Nov 2015 07:24:33 -0800 (PST)
Date: Thu, 26 Nov 2015 20:54:33 +0530
Message-ID: 
 <CAL9_ArhPk6s-7TaveiX+5Ety59f8fzwXHfO+xEF0gTmJBg2btQ@mail.gmail.com>
Subject: Replication Problem
From: prashant madaan <prashantmadaan123@gmail.com>
To: dev@falcon.apache.org
Content-Type: multipart/alternative; boundary=94eb2c0b63c0081b450525732c14

--94eb2c0b63c0081b450525732c14
Content-Type: text/plain; charset=UTF-8

Hi team,
Hope you are doing good.

I was doing some testing on falcon but stuck up with below issue. looking
for some quick response on this.

The issue I am facing are :

* Replication Issues :*

I have a process that runs an oozie workflow and passes the time parameters
of 7 hours before the current time of falcon job . Below is the value i
pass :
<property name="feed_date" value="${formatTime(dateOffset(instanceTime(),
-7, 'HOUR'),'yyyy-MM-dd')}" />

<property name="feed_hour" value="${formatTime(dateOffset(instanceTime(),
-7, 'HOUR'),'HH')}" />

I have built a feed for replication and mentioned the late arrival cutoff
to be hours(10).

But the issue is that the the data comes late, approximately 7 hours from
the current running time and the feed entity runs on the current time . The
late cut off works for 4 5 iterations of this but then it stops the
replication .

Note: The frequency of the feed entity as well as the process entity  is
hours(1).

Example :

Suppose Current time is 10 AM

The data comes for 3 AM hour.

I schedule this process at 10 am and the data gets picked up and is
processed and the feed replication runs fine .

Similar things happen for the next 3 4 iterations , but after that the feed
replication does not kick off at all (Thus i cannot check the logs) but the
process entity runs fine .


Please let me know how to fix this issue . Also can we make falcon run 7
hours late from the current time . For example

Feed Replication Path contains /xyz/${YEAR}-${MONTH}-${DAY}/${HOUR}/abc

This picks up the current falcon time . But i want it to always run 7 hours
behind the current time .


Any Help is appreciated .

Thanks and Regards

Prashant Madaan

--94eb2c0b63c0081b450525732c14--