Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id AFF9B200BD8 for ; Wed, 2 Nov 2016 00:29:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id AE8C8160B02; Tue, 1 Nov 2016 23:29:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 05F43160B0A for ; Wed, 2 Nov 2016 00:28:59 +0100 (CET) Received: (qmail 55054 invoked by uid 500); 1 Nov 2016 23:28:58 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 55015 invoked by uid 99); 1 Nov 2016 23:28:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 Nov 2016 23:28:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 85E002C2A69 for ; Tue, 1 Nov 2016 23:28:58 +0000 (UTC) Date: Tue, 1 Nov 2016 23:28:58 +0000 (UTC) From: "NITIN VERMA (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HADOOP-13783) Improve efficiency of WASB over page blobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 01 Nov 2016 23:29:00 -0000 [ https://issues.apache.org/jira/browse/HADOOP-13783?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D15= 627043#comment-15627043 ]=20 NITIN VERMA commented on HADOOP-13783: -------------------------------------- Thanks [~liuml07] > Improve efficiency of WASB over page blobs > ------------------------------------------ > > Key: HADOOP-13783 > URL: https://issues.apache.org/jira/browse/HADOOP-13783 > Project: Hadoop Common > Issue Type: Bug > Components: azure > Reporter: NITIN VERMA > Assignee: NITIN VERMA > > 1)=09Add telemetry to WASB driver. WASB driver is lack of any log or tele= metry which makes trouble shoot very difficult. For example, we don=E2=80= =99t know where is high e2e latency between HBase and Azure storage came fr= om when Azure storage server latency was very low. Also we don=E2=80=99t kn= ow why WASB can only do 166 IOPs which is way below azure storage 500 IOPs.= And we had several incidents before related to storage latency, because of= lacking logs, we couldn=E2=80=99t find the ownership of the incident quick= ly. > 2)=09Resolving the hot spotting issue when WASB driver partition the azur= e page blobs by changing the key. Current key design is causing the hot spo= tting on azure storage.=20 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-issues-help@hadoop.apache.org