Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C575A200C08 for ; Thu, 26 Jan 2017 21:36:45 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id C4088160B4C; Thu, 26 Jan 2017 20:36:45 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 19135160B31 for ; Thu, 26 Jan 2017 21:36:44 +0100 (CET) Received: (qmail 42679 invoked by uid 500); 26 Jan 2017 20:36:44 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 42662 invoked by uid 99); 26 Jan 2017 20:36:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jan 2017 20:36:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 7E40D18C8E6 for ; Thu, 26 Jan 2017 20:36:43 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.398 X-Spam-Level: ** X-Spam-Status: No, score=2.398 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id I9UAdPGgKcA2 for ; Thu, 26 Jan 2017 20:36:38 +0000 (UTC) Received: from mail-yb0-f175.google.com (mail-yb0-f175.google.com [209.85.213.175]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 962E05F644 for ; Thu, 26 Jan 2017 20:36:38 +0000 (UTC) Received: by mail-yb0-f175.google.com with SMTP id w194so160118687ybe.0 for ; Thu, 26 Jan 2017 12:36:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=VHTUb2IObNZAjyPn1mKveF7aZIRRKfSW4vbSUhFgZkc=; b=jN8TVlkmaePBXyrS1vFhHixsN9qGS6Kh4IWWnq4MRmaBwi9CEpe5lSH9WnWjkBUAL8 iWPK67DoMJUoucOsC9bL0G30+zZoSV14uA8xujruLCf8m7cmO7jzfN5UxWwN7XcYxnh4 NJAgzh1UqLs/HcwvmCc/Y+7T2ihI3ECnW+y/b6PnDdWOMoeYkqPvl1cz0jt+Afi6QuNd OnkuuFo7O5ZxwxxFmUB0lpMeiWAef+DqyTm/pWb2kz2ZwMgGsildZSa4yHh2gCjKCWog DsWL1lG7tcAX6dkwqazZr/a4MmnKp6SUbUdIddaKs/bgJ0sMpjqAZJLdztRVVkSdx98n DkLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=VHTUb2IObNZAjyPn1mKveF7aZIRRKfSW4vbSUhFgZkc=; b=md51P8is+52+0gIaokh2tEt3wAMO5os0Q2ET4m8HHmcdeVwLAzEkNBv9iBuSeWnF5C gLVDf+iYT09qle6l/687OXNQH/On25eSBt8Z9W6QDzs8be71AzzZ2lwJIeymVLeDtFEQ 4/Q1kVnaPh/0GbPcWuJifJtcZe5zoTfoOWug7rnzaMm5SL4JmjujA/ueiKfNlT3odvyk OZDAAmDZmgU8xX9TNxjqNjR2bMSd3FSFIe5Rbpz6Ni1WNC6b9/wUfOvMlGFW9x3MjFbJ Gz2YjhFBKO1R8L0VWnxDekPZWKex+AdcdBZ/ozAXJl3BZZHv2Hr282lvdc5NMRvOXLkw azvw== X-Gm-Message-State: AIkVDXLS/maompHZYVnTIg3lFWsnpa1UZI+Tvyl1sJeIZodExrX7UZFLSYeMDDIy5D8zPJC39uTaQp1nZQhwsg== X-Received: by 10.37.178.1 with SMTP id i1mr3608607ybj.16.1485462998044; Thu, 26 Jan 2017 12:36:38 -0800 (PST) MIME-Version: 1.0 Received: by 10.129.82.13 with HTTP; Thu, 26 Jan 2017 12:36:37 -0800 (PST) From: Alexei Scherbakov Date: Thu, 26 Jan 2017 23:36:37 +0300 Message-ID: Subject: Transactional tasks To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=f403045e4bea537f010547054ed5 archived-at: Thu, 26 Jan 2017 20:36:46 -0000 --f403045e4bea537f010547054ed5 Content-Type: text/plain; charset=UTF-8 Guys, How difficult would be to support transactional tasks? What means every job in task executed in it's own transaction. In case of single job failure or reduce phase failure all transaction started by jobs are rolled back. Only if all jobs are successfully executed, corresponding transactions are commited. Also it would be very desirable to implement tasks failover in the similar way how jobs failover is implemented. In case of master's failure jobs are rolled back, and task is restarted on another node. This should greatly simplify implementing complex business processes. -- Best regards, Alexei Scherbakov --f403045e4bea537f010547054ed5--