Mailing-List: contact stdcxx-dev-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: stdcxx-dev@incubator.apache.org
Received-SPF: pass (herse.apache.org: local policy)
Message-ID: <460418A9.1070307@roguewave.com>
Date: Fri, 23 Mar 2007 12:12:57 -0600
From: Martin Sebor <sebor@roguewave.com>
Organization: Rogue Wave Software
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
 rv:1.8.1.2) Gecko/20070221 SeaMonkey/1.1.1
MIME-Version: 1.0
To: stdcxx-dev@incubator.apache.org
Subject: Re: legacy tests on Windows
References: <4603FBC8.6040804@roguewave.com> <46041303.6040209@roguewave.com>
In-Reply-To: <46041303.6040209@roguewave.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Andrew Black wrote:
> Greetings Martin.
> 
> I think it's likely that we will need to make some changes to the
> windows infrastructure.
> 
> The cause of the missing legacy tests is twofold.  First, the legacy
> test executables appear to fail to compile in dynamic builds because the 
> legacy test driver symbols aren't resolved.  This seems to point to a 
> failure to export them correctly.

Ah. That's something we need to look into here as the legacy
part of the driver isn't in Subversion

> Second, the runall.wsf script doesn't 
> pass the names of non-existent executables to the exec script. 
> Therefore, you don't see any targets in the COMPILE or LINK states when 
> the exec utility runs.

IMO, this needs to change. The table must show the status
of all the tests, not just those that compiled and linked
successfully.

Unless you see a quick change that your or I could easily
make ourselves I'll ask Farid to do it since he is the
expert on the Windows scripts.

> 
> Looking at the runall.wsf and generated .stdcxx_runtests solution, I 
> believe that the cause of the format messages likely is coming from a 
> failure to pass the compatibility mode options to the test suite. Farid, 
> the additional switches that need to be passed to the exec utility when 
> running the tests are '--compat -x "--compat -O -"' (minus the single 
> quotes).  Hopefully the shell will handle the quote processing correctly.

That was suspicion as well. Again, unless you see a quick
fix let's wait for Farid to fix it.

Martin

> 
> --Andrew Black
> 
> Martin Sebor wrote:
>> I noticed that the legacy tests (like 21_native.exe) are reported
>> with the status of FORMAT in some of our most recent results (from
>> this morning) and missing from others.
>>
>> Andrew, do you have any idea what's going on here? Do we still need
>> to change the Windows test harness to enable the legacy output mode
>> in the driver? What about the builds where they are missing?
>>
>> Legacy tests with FORMAT status:
>> http://people.apache.org/~sebor/stdcxx/results/windows-vista-amd64-msvc-64b-8.0-15s-log.gz.txt 
>>
>>
>> Missing legacy tests:
>> http://people.apache.org/~sebor/stdcxx/results/windows-vista-amd64-msvc-64b-8.0-12d-log.gz.txt 
>>
>>
>> Thanks
>> Martin
>