summaryrefslogtreecommitdiff
path: root/lib/sbin/RunTest.pl
Commit message (Collapse)AuthorAge
* implement per-variable tolerances for Cactus testsuites, for long ↵knarf2012-02-23
| | | | | | discussion, see ET ticket #114 git-svn-id: http://svn.cactuscode.org/flesh/trunk@4791 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Add number of processes to testsuite outputeschnett2011-12-12
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@4776 17b73243-c579-4c4c-a9d2-2d5706c11dac
* add support for testsuite data as (optionally compressed) tarballknarf2011-09-26
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@4736 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Implement and document the new possibility to specify the number of processorstradke2007-01-18
| | | | | | | | | | required to run a testsuite in a thorn's test.ccl configuration file. This closes PR 2078/Cactus: "specify the number of processors required to run a testsuite". git-svn-id: http://svn.cactuscode.org/flesh/trunk@4401 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Added debugging code which allows simultaneous debugging of RunTest.plrideout2004-01-13
| | | | | | | | | | | | | | | and RunTestUtils.pl. Commented reference to $loop in RunTest.pl's main loop, since it is not referenced anywhere else. Fixed ViewResults to handle the case when a file is missing from the test output or test archive. Some minor cleanup and performance improvements to CompareTestFiles. git-svn-id: http://svn.cactuscode.org/flesh/trunk@3504 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Parse a config file in a test directory to set a different relative orallen2003-07-23
| | | | | | | | absolute tolerance for the whole testsuite. The notation will change in the future so I don't think this feature will be documented properly yet. git-svn-id: http://svn.cactuscode.org/flesh/trunk@3349 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Get the configuration name right in the test outputallen2002-05-31
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@2881 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Added support for a config file for testsuites, where IO thorns can provide ↵allen2002-05-29
| | | | | | | | | | | | | | | information about the data files which they produce, and thorns providing testsuites can provide information about the tests they are supplying. The syntax for the config file is not finalised yet, and will be subject to change depending on the feedback we get. The config file is called "config" and must be located in the "test" directory of a thorn. Right now, the only line recognized is EXTENSIONS dat xl yl zl which should be added by any thorn providing output files eg with extensions dat xl yl zl which should be tested. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2864 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Added an option to rerun a test but show the Cactus output on screenallen2002-04-27
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@2765 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Added back prompt command to scripts this means thatallen2002-04-26
| | | | | | | | | | gmake <config>-testsuite PROMPT=no will run through with the defaults for everything, including running all the tests, and then stop. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2757 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Removed debug statementallen2002-04-24
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@2752 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Fixed bug where par files which core dumped would passallen2002-04-24
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@2751 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Sorted out referencing a bit better, hopefully removes problem with a /%allen2002-04-24
| | | | | | | with a couple of people saw ... git-svn-id: http://svn.cactuscode.org/flesh/trunk@2749 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Can now set absolute or relative tolerance for all runs ... need to work outallen2002-04-23
| | | | | | | | still how to get to this menu in other cases and how to add this information to the end summary, and whether a testsuite should be able to set it's tolerance itself etc. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2748 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Add viewing output files to menuallen2002-04-22
| | | | git-svn-id: http://svn.cactuscode.org/flesh/trunk@2742 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Reworked the comparing part of the routineallen2002-04-22
| | | | | | | | | | | | | | | | | | | | | | | - now use absolute and relative errors test is |v1 - v2| < max ( abs_tol, rel_tol*max(|v1|,|v2|) where for now abs_tol = 1e-12 and rel_tol = 0 which should be what we had before (new implementation now means that a difference of 1000 doesn't pass!) - check values in first column (coordinates) as well as second column - give more information about the comparisons At the moment you can't set the rel_tol yourself but I do print what you would need for a test to pass to screen. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2741 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Splitting up database into configuration, static and dynamic stuff.allen2002-04-21
| | | | | | | | | | | Added an initial try at interactively looking at the differences between files, now there are options to list both files, diff them or xgraph them. Any comments on the new testsuites are very welcome, in particular on the interfaces, please mail flesh@cactuscode.org with any suggestions. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2736 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Mainly reorganising of the database and removing unneeded local variables.allen2002-04-16
| | | | | | | | | | Broke up the runtest subroutine into running the test and reporting on the test. Includes fix for Cactus/451 (don't report NaNs/Infs which should be there) git-svn-id: http://svn.cactuscode.org/flesh/trunk@2720 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Fixed bug in last commit, and added ability to run all testsuites for aallen2002-04-14
| | | | | | | chosen thorn (not for an arrangement yet). git-svn-id: http://svn.cactuscode.org/flesh/trunk@2718 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Change to user interface. Unfortunately now I replaced the choiceallen2002-04-14
| | | | | | | | | | | | "All" with "Entire" so as not to clash with "Arrangement", but the default is still to run all tests so it shouldn't be too bad. Will add soon an option to run all the tests for a thorn/arrangement. Closes Cactus/802 git-svn-id: http://svn.cactuscode.org/flesh/trunk@2717 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Remove all pwds to fix Cactus/480allen2002-04-14
| | | | | | | | The test directory can now be set to any location by setting an environment variable TESTS_DIR git-svn-id: http://svn.cactuscode.org/flesh/trunk@2716 17b73243-c579-4c4c-a9d2-2d5706c11dac
* Somewhat tidied up version of Runtest for doing testsuite checking. Thisallen2002-04-13
is in preparation for getting together a complete spec for and doing it properly. A lot of the internals have been changed around, so in case of problems I've left the original version there for the moment, to run the original version just edit Makefile and replace RunTest.pl with Runtest.pl The main differences though should be - a lot more output at the end, probably too much, would welcome any ideas on what information to display and how - better menu interface for choosing a test to run, also started adding a couple of other features. Hopefully removed all the infinite loops from the menu. - now works properly when a test with the same name is in two different thorns ... note that this meant adding an extra layer of directories in the TEST directory so if anyone uses a path to the output files in the TEST directories (like in the testsuites for IOHDF5/IOFlexIO) these will need to be changed. Should now be able to go on to fix outstanding requests in gnats for the testsuites. git-svn-id: http://svn.cactuscode.org/flesh/trunk@2712 17b73243-c579-4c4c-a9d2-2d5706c11dac