Return-Path: X-Original-To: apmail-beam-commits-archive@minotaur.apache.org Delivered-To: apmail-beam-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 48F7F187EF for ; Sun, 14 Feb 2016 14:56:21 +0000 (UTC) Received: (qmail 28070 invoked by uid 500); 14 Feb 2016 14:56:21 -0000 Delivered-To: apmail-beam-commits-archive@beam.apache.org Received: (qmail 28036 invoked by uid 500); 14 Feb 2016 14:56:21 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 28027 invoked by uid 99); 14 Feb 2016 14:56:21 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Feb 2016 14:56:21 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id CE940C0909 for ; Sun, 14 Feb 2016 14:56:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.349 X-Spam-Level: X-Spam-Status: No, score=-4.349 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.329] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id r_t42omFeD9v for ; Sun, 14 Feb 2016 14:56:20 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id 2865424C68 for ; Sun, 14 Feb 2016 14:56:19 +0000 (UTC) Received: (qmail 24430 invoked by uid 99); 14 Feb 2016 14:56:18 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 14 Feb 2016 14:56:18 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 547B92C14F2 for ; Sun, 14 Feb 2016 14:56:18 +0000 (UTC) Date: Sun, 14 Feb 2016 14:56:18 +0000 (UTC) From: "bakeypan (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (BEAM-12) Apply GroupByKey transforms on PCollection MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bakeypan updated BEAM-12: ------------------------- Description: Now the GroupByKey transforms can only apply on PCollection>.So I have to transform PCollection to PCollection> before I want to apply GroupByKey. I think we can do better by apply GroupByKey on normal type of PCollection other than KV.And user can offer one custome extract key function or we can offer default extract key function.Just like this: PCollection input = ... PCollection>> result = input.apply(GroupByKey.create(new ExtractFn())); > Apply GroupByKey transforms on PCollection > ------------------------------------------ > > Key: BEAM-12 > URL: https://issues.apache.org/jira/browse/BEAM-12 > Project: Beam > Issue Type: Improvement > Reporter: bakeypan > > Now the GroupByKey transforms can only apply on PCollection>.So I have to transform PCollection to PCollection> before I want to apply GroupByKey. > I think we can do better by apply GroupByKey on normal type of PCollection other than KV.And user can offer one custome extract key function or we can offer default extract key function.Just like this: > PCollection input = ... > PCollection>> result = input.apply(GroupByKey.create(new ExtractFn())); -- This message was sent by Atlassian JIRA (v6.3.4#6332)