Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5D581200C5E for ; Sat, 22 Apr 2017 12:35:13 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5BF54160B96; Sat, 22 Apr 2017 10:35:13 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A2729160B93 for ; Sat, 22 Apr 2017 12:35:12 +0200 (CEST) Received: (qmail 5186 invoked by uid 500); 22 Apr 2017 10:35:11 -0000 Mailing-List: contact dev-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.apache.org Delivered-To: mailing list dev@apex.apache.org Received: (qmail 5174 invoked by uid 99); 22 Apr 2017 10:35:11 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 22 Apr 2017 10:35:11 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6BDB3C04DE for ; Sat, 22 Apr 2017 10:35:11 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ivZHF_bcJOGn for ; Sat, 22 Apr 2017 10:35:10 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 7265C5F477 for ; Sat, 22 Apr 2017 10:35:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id CD59DE0041 for ; Sat, 22 Apr 2017 10:35:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 35D1421B52 for ; Sat, 22 Apr 2017 10:35:04 +0000 (UTC) Date: Sat, 22 Apr 2017 10:35:04 +0000 (UTC) From: "Ananth (JIRA)" To: dev@apex.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (APEXMALHAR-2472) Implement Kudu Input Operator MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sat, 22 Apr 2017 10:35:13 -0000 [ https://issues.apache.org/jira/browse/APEXMALHAR-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ananth updated APEXMALHAR-2472: ------------------------------- Issue Type: New Feature (was: Bug) > Implement Kudu Input Operator > ------------------------------ > > Key: APEXMALHAR-2472 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2472 > Project: Apache Apex Malhar > Issue Type: New Feature > Components: adapters database > Reporter: Ananth > Assignee: Ananth > > This operator would allow Kudu to be used as an Input store. This has multiple advantages like : > - Ability to solve the dedup problem from entire data set perspective. The dedupe operators we have today are primarily window based and this might not meet all of the use cases in real world. > - Ability to selectively stream data based on a SQL expression. Since Kudu is a structural store, we could effectively allow a SQL expression based "input" definition that would allow for selective streaming for all downstream operators. This could potentially be an alternative streaming store pattern as compared to Kafka as Kafka does not allow for selective streaming of tuples. -- This message was sent by Atlassian JIRA (v6.3.15#6346)