From hdfs-issues-return-256943-archive-asf-public=cust-asf.ponee.io@hadoop.apache.org Mon Mar 18 18:22:05 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 3001D180651 for ; Mon, 18 Mar 2019 19:22:05 +0100 (CET) Received: (qmail 93599 invoked by uid 500); 18 Mar 2019 18:22:04 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 93582 invoked by uid 99); 18 Mar 2019 18:22:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Mar 2019 18:22:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9786CC11A9 for ; Mon, 18 Mar 2019 18:22:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.501 X-Spam-Level: X-Spam-Status: No, score=-109.501 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id LnEpLQfDbIEA for ; Mon, 18 Mar 2019 18:22:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id DDDBE60E75 for ; Mon, 18 Mar 2019 18:22:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 0B9AAE2961 for ; Mon, 18 Mar 2019 18:22:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id A9FEA2459C for ; Mon, 18 Mar 2019 18:22:00 +0000 (UTC) Date: Mon, 18 Mar 2019 18:22:00 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HDDS-1250) In OM HA AllocateBlock call where connecting to SCM from OM should not happen on Ratis MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDDS-1250?focusedWorklogId=3D2= 14931&page=3Dcom.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpan= el#worklog-214931 ] ASF GitHub Bot logged work on HDDS-1250: ---------------------------------------- Author: ASF GitHub Bot Created on: 18/Mar/19 18:21 Start Date: 18/Mar/19 18:21 Worklog Time Spent: 10m=20 Work Description: bharatviswa504 commented on issue #591: HDDS-1250: = IIn OM HA AllocateBlock call where connecting to SCM from OM should not hap= pen on Ratis. URL: https://github.com/apache/hadoop/pull/591#issuecomment-474041921 =20 =20 Test failure's failing are failing due to=20 300000 is not within min =3D 500 or max =3D 100000 =20 This will be taken care in the below jira. https://issues.apache.org/jira/browse/HDDS-1297 =20 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. =20 For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 214931) Time Spent: 3h 40m (was: 3.5h) > In OM HA AllocateBlock call where connecting to SCM from OM should not ha= ppen on Ratis > -------------------------------------------------------------------------= ------------- > > Key: HDDS-1250 > URL: https://issues.apache.org/jira/browse/HDDS-1250 > Project: Hadoop Distributed Data Store > Issue Type: Sub-task > Reporter: Bharat Viswanadham > Assignee: Bharat Viswanadham > Priority: Major > Labels: pull-request-available > Time Spent: 3h 40m > Remaining Estimate: 0h > > In OM HA, currently when allocateBlock=C2=A0is called, in applyTransactio= n() on all OM nodes, we make a call to SCM and write the allocateBlock info= rmation into OM DB. The problem with this is, every OM allocateBlock and ap= pends new BlockInfo into OMKeyInfom and also this a correctness issue. (As = all OM's should have the same block information for a key, even though even= tually this might be changed during key commit) > =C2=A0 > The proposed approach is: > 1. Calling SCM for allocation of block will happen outside of ratis, and = this block information is passed and=C2=A0writing to DB will happen via Rat= is. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org