From issues-return-138288-archive-asf-public=cust-asf.ponee.io@beam.apache.org Thu Dec 31 09:24:02 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mxout1-ec2-va.apache.org (mxout1-ec2-va.apache.org [3.227.148.255]) by mx-eu-01.ponee.io (Postfix) with ESMTPS id CAA75180638 for ; Thu, 31 Dec 2020 10:24:01 +0100 (CET) Received: from mail.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by mxout1-ec2-va.apache.org (ASF Mail Server at mxout1-ec2-va.apache.org) with SMTP id 11D1644C60 for ; Thu, 31 Dec 2020 09:24:01 +0000 (UTC) Received: (qmail 74021 invoked by uid 500); 31 Dec 2020 09:24:00 -0000 Mailing-List: contact issues-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list issues@beam.apache.org Received: (qmail 73996 invoked by uid 99); 31 Dec 2020 09:24:00 -0000 Received: from ec2-52-204-25-47.compute-1.amazonaws.com (HELO mailrelay1-ec2-va.apache.org) (52.204.25.47) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 31 Dec 2020 09:24:00 +0000 Received: from jira2-he-de.apache.org (jira2-he-de.apache.org [168.119.33.54]) by mailrelay1-ec2-va.apache.org (ASF Mail Server at mailrelay1-ec2-va.apache.org) with ESMTPS id B23FA3E878 for ; Thu, 31 Dec 2020 09:24:00 +0000 (UTC) Received: from jira2-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira2-he-de.apache.org (ASF Mail Server at jira2-he-de.apache.org) with ESMTP id 112F1C80155 for ; Thu, 31 Dec 2020 09:24:00 +0000 (UTC) Date: Thu, 31 Dec 2020 09:24:00 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: issues@beam.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (BEAM-11457) Enable skip key-value clone for HadoopFormatIO MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/BEAM-11457?focusedWorklogId=529736&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-529736 ] ASF GitHub Bot logged work on BEAM-11457: ----------------------------------------- Author: ASF GitHub Bot Created on: 31/Dec/20 09:23 Start Date: 31/Dec/20 09:23 Worklog Time Spent: 10m Work Description: JozoVilcek commented on pull request #13543: URL: https://github.com/apache/beam/pull/13543#issuecomment-752900693 retest this please ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 529736) Time Spent: 1h (was: 50m) > Enable skip key-value clone for HadoopFormatIO > ----------------------------------------------- > > Key: BEAM-11457 > URL: https://issues.apache.org/jira/browse/BEAM-11457 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop-format > Affects Versions: 2.25.0 > Reporter: Jozef Vilcek > Assignee: Jozef Vilcek > Priority: P3 > Time Spent: 1h > Remaining Estimate: 0h > > HadoopFormatIO eagerly clone key-values if they are not a well known immutable types. This make sense due to how hadoop Writables behave. However, user can use key value translation functions which possibly already output immutable types. In such case it would be of benefit if extra clone via coder can be avoided. > It would be great if coder can be consulted on the type an it's need for clone. However I am not aware if such detection is possible. I propose to add config parameter for skipping the clone which can be used by IO user. -- This message was sent by Atlassian Jira (v8.3.4#803005)