Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6A9457FFD for ; Fri, 14 Oct 2011 05:52:41 +0000 (UTC) Received: (qmail 3804 invoked by uid 500); 14 Oct 2011 05:52:39 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 3659 invoked by uid 500); 14 Oct 2011 05:52:37 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 3616 invoked by uid 99); 14 Oct 2011 05:52:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2011 05:52:33 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2011 05:52:32 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id D0A3A307D17 for ; Fri, 14 Oct 2011 05:52:11 +0000 (UTC) Date: Fri, 14 Oct 2011 05:52:11 +0000 (UTC) From: "Jonathan Gray (Commented) (JIRA)" To: issues@hbase.apache.org Message-ID: <1705521641.12775.1318571531855.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1690639996.8828.1310068336655.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-4078) Silent Data Offlining During HDFS Flakiness MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13127281#comment-13127281 ] Jonathan Gray commented on HBASE-4078: -------------------------------------- This seems to have somehow broken cache-on-write again. I think because the verify does a closeReader() which could trigger the evict-on-close. I'm going to need to extend the close API to take evictOnClose as an argument. I think there's actually a JIRA for this already. > Silent Data Offlining During HDFS Flakiness > ------------------------------------------- > > Key: HBASE-4078 > URL: https://issues.apache.org/jira/browse/HBASE-4078 > Project: HBase > Issue Type: Bug > Components: io, regionserver > Affects Versions: 0.89.20100924, 0.90.3, 0.92.0 > Reporter: Nicolas Spiegelberg > Assignee: Pritam Damania > Priority: Blocker > Fix For: 0.92.0, 0.94.0 > > Attachments: 0001-Validate-store-files-after-compactions-flushes.patch, 0001-Validate-store-files.patch > > > See HBASE-1436 . The bug fix for this JIRA is a temporary workaround for improperly moving partially-written files from TMP into the region directory when a FS error occurs. Unfortunately, the fix is to ignore all IO exceptions, which masks off-lining due to FS flakiness. We need to permanently fix the problem that created HBASE-1436 & then at least have the option to not open a region during times of flakey FS. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira