Return-Path: Delivered-To: apmail-incubator-stdcxx-dev-archive@www.apache.org Received: (qmail 79100 invoked from network); 20 Dec 2007 01:50:04 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 20 Dec 2007 01:50:04 -0000 Received: (qmail 97491 invoked by uid 500); 20 Dec 2007 01:49:53 -0000 Delivered-To: apmail-incubator-stdcxx-dev-archive@incubator.apache.org Received: (qmail 97477 invoked by uid 500); 20 Dec 2007 01:49:53 -0000 Mailing-List: contact stdcxx-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: stdcxx-dev@incubator.apache.org Delivered-To: mailing list stdcxx-dev@incubator.apache.org Received: (qmail 97466 invoked by uid 99); 20 Dec 2007 01:49:53 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Dec 2007 17:49:53 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO brutus.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 20 Dec 2007 01:49:40 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 466F0714276 for ; Wed, 19 Dec 2007 17:49:43 -0800 (PST) Message-ID: <19632472.1198115383286.JavaMail.jira@brutus> Date: Wed, 19 Dec 2007 17:49:43 -0800 (PST) From: "Martin Sebor (JIRA)" To: stdcxx-dev@incubator.apache.org Subject: [jira] Updated: (STDCXX-683) implement notion of expected failures in the test suite In-Reply-To: <30925263.1198022396574.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/STDCXX-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Sebor updated STDCXX-683: -------------------------------- Attachment: (was: codes.html) > implement notion of expected failures in the test suite > ------------------------------------------------------- > > Key: STDCXX-683 > URL: https://issues.apache.org/jira/browse/STDCXX-683 > Project: C++ Standard Library > Issue Type: New Feature > Components: Test Driver, Tests > Affects Versions: 4.2.0 > Reporter: Martin Sebor > Assignee: Martin Sebor > Priority: Critical > Attachments: codes.html, xcodes.html > > > Tests (or examples) that fail for known reasons that we haven't been able to deal with should be distinguished from failures that haven't been analyzed yet. For example, an example program that fails to compile on an older target platform because of a compiler bug that we can't find a simple/elegant workaround should be flagged as such in the test results. Similarly, a test that fails one or more assertions due to compiler or libc bugs on a specific platform (or a set of platforms) that we are unable to work around should be reported as such. > This is important in order to reduce the currently fairly large number of unexpected failures and to be able to make changes without having to worry about regressions as much. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.