Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7BCAC200D13 for ; Sat, 16 Sep 2017 06:47:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7AFF41609D3; Sat, 16 Sep 2017 04:47:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C00631609D1 for ; Sat, 16 Sep 2017 06:47:04 +0200 (CEST) Received: (qmail 5817 invoked by uid 500); 16 Sep 2017 04:47:03 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 5805 invoked by uid 99); 16 Sep 2017 04:47:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 16 Sep 2017 04:47:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 2F9841A19C4 for ; Sat, 16 Sep 2017 04:47:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id c6HlkaUjKGjE for ; Sat, 16 Sep 2017 04:47:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 32F555FAF3 for ; Sat, 16 Sep 2017 04:47:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id ADF58E0EE8 for ; Sat, 16 Sep 2017 04:47:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 6E25F25389 for ; Sat, 16 Sep 2017 04:47:00 +0000 (UTC) Date: Sat, 16 Sep 2017 04:47:00 +0000 (UTC) From: "Xiaoyu Yao (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sat, 16 Sep 2017 04:47:05 -0000 [ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168816#comment-16168816 ] Xiaoyu Yao commented on HDFS-11873: ----------------------------------- I think it is caused by some uncleaned setting of cluster configuration for local storage root {{conf.setBoolean(OzoneConfigKeys.OZONE_LOCALSTORAGE_ROOT, true);}} for local handler. Update patch v3 to fix the checkstyle and the asf license issue due to the wrong test root created and left over after the test. > Ozone: Object store handler cannot serve multiple requests from single http client > ---------------------------------------------------------------------------------- > > Key: HDFS-11873 > URL: https://issues.apache.org/jira/browse/HDFS-11873 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone > Reporter: Weiwei Yang > Assignee: Xiaoyu Yao > Priority: Critical > Labels: ozoneMerge > Attachments: HDFS-11873-HDFS-7240.001.patch, HDFS-11873-HDFS-7240.002.patch, HDFS-11873-HDFS-7240.003.patch, HDFS-11873-HDFS-7240.testcase.patch > > > This issue was found when I worked on HDFS-11846. Instead of creating a new http client instance per request, I tried to reuse {{CloseableHttpClient}} in {{OzoneClient}} class in a {{PoolingHttpClientConnectionManager}}. However, every second request from the http client hangs, which could not get dispatched to {{ObjectStoreJerseyContainer}}. There seems to be something wrong in the netty pipeline, this jira aims to 1) fix the problem in the server side 2) use the pool for client http clients to reduce the resource overhead. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org