Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 36743200D0F for ; Fri, 25 Aug 2017 00:00:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3501E16BB7B; Thu, 24 Aug 2017 22:00:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8283516BB78 for ; Fri, 25 Aug 2017 00:00:09 +0200 (CEST) Received: (qmail 25674 invoked by uid 500); 24 Aug 2017 22:00:06 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 25663 invoked by uid 99); 24 Aug 2017 22:00:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Aug 2017 22:00:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 16E77C5CCB for ; Thu, 24 Aug 2017 22:00:06 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 42FD_IV5Fhv0 for ; Thu, 24 Aug 2017 22:00:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 459985F298 for ; Thu, 24 Aug 2017 22:00:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id B782FE08B4 for ; Thu, 24 Aug 2017 22:00:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 5EE682537E for ; Thu, 24 Aug 2017 22:00:04 +0000 (UTC) Date: Thu, 24 Aug 2017 22:00:04 +0000 (UTC) From: "Josh Elser (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-18679) YARN may null Counters object and cause an NPE in ITBLL MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 24 Aug 2017 22:00:10 -0000 [ https://issues.apache.org/jira/browse/HBASE-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HBASE-18679: ------------------------------- Attachment: HBASE-18679.001.patch .001 Really trivial patch -- checks if the {{Counters}} object is null, and bails out fast (failing verification) when it happens. Nothing we can do in hbase-landia, user has to remedy via their configuration. > YARN may null Counters object and cause an NPE in ITBLL > ------------------------------------------------------- > > Key: HBASE-18679 > URL: https://issues.apache.org/jira/browse/HBASE-18679 > Project: HBase > Issue Type: Bug > Components: integration tests > Reporter: Josh Elser > Assignee: Josh Elser > Priority: Trivial > Fix For: 2.0.0, 1.4.0, 1.3.2, 1.5.0, 1.2.7, 1.1.13 > > Attachments: HBASE-18679.001.patch > > > YARN has a configuration limit to the number of counters that a job can create (to avoid some bad job from DDOS'ing the service). > When running ITBLL, we ran into this limit due to the default configuration rather low at the time. When YARN notices that the counter limit has been exceeded, it nulls out the Counters object obtained by the Job. > Presently in ITBLL, we have a few places where we (reasonably ;)) assume that the Counters object would be non-null. Can easily fix this with a null-check. -- This message was sent by Atlassian JIRA (v6.4.14#64029)