Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4BFF21800D for ; Wed, 13 May 2015 12:10:06 +0000 (UTC) Received: (qmail 79738 invoked by uid 500); 13 May 2015 12:10:06 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 79684 invoked by uid 500); 13 May 2015 12:10:06 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 79672 invoked by uid 99); 13 May 2015 12:10:06 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 May 2015 12:10:06 +0000 Date: Wed, 13 May 2015 12:10:05 +0000 (UTC) From: "Vinayakumar B (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541816#comment-14541816 ] Vinayakumar B commented on HDFS-8019: ------------------------------------- bq. Might it be the configuration support a bit overkill? Could we start with simple? Anyway, configurations are not made mandatory. For starting we could define optimal default values. As configurations would always help for testing without need of code change everytime. What you say? > Erasure Coding: erasure coding chunk buffer allocation and management > --------------------------------------------------------------------- > > Key: HDFS-8019 > URL: https://issues.apache.org/jira/browse/HDFS-8019 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Kai Zheng > Assignee: Vinayakumar B > Attachments: HDFS-8019-HDFS-7285-01.patch, HDFS-8019-HDFS-7285-02.patch > > > As a task of HDFS-7344, this is to come up a chunk buffer pool allocating and managing coding chunk buffers, either based on on-heap or off-heap. Note this assumes some DataNodes are powerful in computing and performing EC coding work, so better to have this dedicated buffer pool and management. -- This message was sent by Atlassian JIRA (v6.3.4#6332)