From dev-return-6456-archive-asf-public=cust-asf.ponee.io@airflow.incubator.apache.org Sat Sep 8 21:50:28 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id C5F64180621 for ; Sat, 8 Sep 2018 21:50:27 +0200 (CEST) Received: (qmail 35404 invoked by uid 500); 8 Sep 2018 19:50:26 -0000 Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@airflow.incubator.apache.org Delivered-To: mailing list dev@airflow.incubator.apache.org Received: (qmail 35392 invoked by uid 99); 8 Sep 2018 19:50:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 Sep 2018 19:50:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 7EA34C0570 for ; Sat, 8 Sep 2018 19:50:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.888 X-Spam-Level: * X-Spam-Status: No, score=1.888 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id bjWDIXmyskGL for ; Sat, 8 Sep 2018 19:50:23 +0000 (UTC) Received: from mail-wr1-f67.google.com (mail-wr1-f67.google.com [209.85.221.67]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 00D0B5F341 for ; Sat, 8 Sep 2018 19:50:22 +0000 (UTC) Received: by mail-wr1-f67.google.com with SMTP id e1-v6so8948922wrt.3 for ; Sat, 08 Sep 2018 12:50:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=ZnCuyznuGH2pSXxS+qWIiAVIoXvbHwe7NdbA81xpv4E=; b=PGlHHChue8zFqBCojwBjTbTVI8LxTOp79UEvvlHZc7QtHgSU13ypy5IWKz+LHS8RcL KJsUC197xTwwVg2jaKhUMwuWbKs7uqvnRz9hSKOM9YY41xlITIYugxCzXULcYE66DWbj 7mUphXjchahnqnDPviGrdYfFZNHfDsacaNOw480MIjgtM1xx9gDzsOe89Ep47DQoCbid xffd9LZaiD0dlMUL6jP2ynQU0wslk0mzUpbfa0Y7ATLSp0e9ia0QGxaAshXL9/P174TM gVBOgxUwwI8pHCkDWXMmCN1HEvcLKTjlMtLKS5hkLAgvpOQ3UAVcgnXrR9yxOVIav4pp n0xw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ZnCuyznuGH2pSXxS+qWIiAVIoXvbHwe7NdbA81xpv4E=; b=bCLMylOIUx+WA+o8JmUXz0rnHz3VqHwAeHuXYzbtwHVKvCtQDfq1gNBEKu9FTGfpp7 nFW31ajRkJOb0Flr/DmbTh/qp4eFZhfMMKS+S5h4CzNKEHLq8+SOgec55SjAIxYemE7R hgosg+LDf/AIYy36FN3hdzZSYu1pOUstzDgixuZtV3Cu2bS+XLkcMWeCvqNNwHueQpkC A5+kF9VMok89Zw+EE02exmWJI2EnvOgf6ioy/jduItz9g/pNOxz10QA3t78S7ZC3Dpzk m3FyGzGoLFiGqKHQSOXSy7159IHn5xb3EHqsll+0fXIRTWYErD30T0E3gnCfnXvkACyT VSag== X-Gm-Message-State: APzg51Aw79pglhl+z/rrM+0YmdSMFMTdgsnlwezr91evoDQ5XtgjAwUt XeBn3ZGaJaTI1odVUA6wHeRaxd8zspO0Tcq8Y4pP2g== X-Google-Smtp-Source: ANB0VdZTKTSqeEHhu8Td0KyedjAx94sJXLPzoTmuzQRUFEbK8cysarNRJ79/M4dQril1F3lLPNXCEDdKBjzbnpwrYpw= X-Received: by 2002:a5d:4250:: with SMTP id s16-v6mr9921548wrr.260.1536436221600; Sat, 08 Sep 2018 12:50:21 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Taylor Edmiston Date: Sat, 8 Sep 2018 15:50:10 -0400 Message-ID: Subject: Re: Use xcom in task retry To: dev@airflow.incubator.apache.org Content-Type: multipart/alternative; boundary="000000000000356a020575616fa9" --000000000000356a020575616fa9 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable XComs push and pull should work as expected when a task is retried. It shouldn't make a difference, but are you using XComs with explicit keys or the implicit return-based style? Is the push succeeding to the database? Also can you show a simplified example of your code for this DAG? Taylor On Thu, Sep 6, 2018 at 12:48 PM Ben Gregory wrote: > Hi Mishika -- > > Posting this question on StackOverflow with some code examples you're usi= ng > will likely be the fastest way to have this addressed. > > Just make sure to tag it with "airflow" so people can find it. > > - Ben > > On Thu, Sep 6, 2018 at 12:12 AM Mishika Singh wrote= : > > > I am pushing some [key,value] using xcom in an operator, which I want t= o > > use when that task fails and comes for retry, for which I am using > > xcom_pull in that operator. But it is returning None instead of that > value. > > Any pointer around this will be helpful. > > > > > > -- > > Regards > > Mishika Singh > > > > > -- > > [image: Astronomer Logo] > > *Ben Gregory* > Data Engineer > > Mobile: +1-615-483-3653 =E2=80=A2 Online: astronomer.io < > https://www.astronomer.io/> > > Download our new ebook. From > Volume > to Value - A Guide to Data Engineering. > --=20 *Taylor Edmiston* Blog | CV | LinkedIn | AngelList | Stack Overflow --000000000000356a020575616fa9--