| Commit message (Collapse) | Author | Age |
|
|
|
|
|
| |
discussion, see ET ticket #114
git-svn-id: http://svn.cactuscode.org/flesh/trunk@4791 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@4776 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@4736 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
| |
required to run a testsuite in a thorn's test.ccl configuration file.
This closes PR 2078/Cactus: "specify the number of processors required to run a
testsuite".
git-svn-id: http://svn.cactuscode.org/flesh/trunk@4401 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
and RunTestUtils.pl.
Commented reference to $loop in RunTest.pl's main loop, since it is
not referenced anywhere else.
Fixed ViewResults to handle the case when a file is missing from the
test output or test archive.
Some minor cleanup and performance improvements to CompareTestFiles.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@3504 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
| |
absolute tolerance for the whole testsuite. The notation will change in the
future so I don't think this feature will be documented properly yet.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@3349 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2881 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
information about the data files which they produce, and thorns providing testsuites can provide information about the tests they are supplying. The syntax for the config file is not finalised yet, and will be subject to change depending on the feedback we get.
The config file is called "config" and must be located in the "test"
directory of a thorn. Right now, the only line recognized is
EXTENSIONS dat xl yl zl
which should be added by any thorn providing output files eg with extensions
dat xl yl zl which should be tested.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2864 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2765 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
| |
gmake <config>-testsuite PROMPT=no
will run through with the defaults for everything, including running all
the tests, and then stop.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2757 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2752 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2751 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
| |
with a couple of people saw ...
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2749 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
| |
still how to get to this menu in other cases and how to add this information
to the end summary, and whether a testsuite should be able to set it's tolerance itself etc.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2748 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
| |
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2742 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
- now use absolute and relative errors
test is
|v1 - v2| < max ( abs_tol, rel_tol*max(|v1|,|v2|)
where for now abs_tol = 1e-12 and rel_tol = 0 which should be what we
had before
(new implementation now means that a difference of 1000 doesn't pass!)
- check values in first column (coordinates) as well as second column
- give more information about the comparisons
At the moment you can't set the rel_tol yourself but I do print what you would need
for a test to pass to screen.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2741 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
|
| |
Added an initial try at interactively looking at the differences between files,
now there are options to list both files, diff them or xgraph them.
Any comments on the new testsuites are very welcome, in particular on the
interfaces, please mail flesh@cactuscode.org with any suggestions.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2736 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
| |
Broke up the runtest subroutine into running the test and reporting on the
test.
Includes fix for Cactus/451 (don't report NaNs/Infs which should be there)
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2720 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
| |
chosen thorn (not for an arrangement yet).
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2718 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
|
|
|
|
| |
"All" with "Entire" so as not to clash with "Arrangement", but the default is
still to run all tests so it shouldn't be too bad.
Will add soon an option to run all the tests for a thorn/arrangement.
Closes Cactus/802
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2717 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
|
|
|
|
|
|
| |
The test directory can now be set to any location by setting an environment
variable TESTS_DIR
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2716 17b73243-c579-4c4c-a9d2-2d5706c11dac
|
|
is in preparation for getting together a complete spec for and doing
it properly.
A lot of the internals have been changed around, so in case of problems
I've left the original version there for the moment, to run the original
version just edit Makefile and replace RunTest.pl with Runtest.pl
The main differences though should be
- a lot more output at the end, probably too much, would welcome any
ideas on what information to display and how
- better menu interface for choosing a test to run, also started adding
a couple of other features. Hopefully removed all the infinite loops
from the menu.
- now works properly when a test with the same name is in two different
thorns ... note that this meant adding an extra layer of directories
in the TEST directory so if anyone uses a path to the output files
in the TEST directories (like in the testsuites for IOHDF5/IOFlexIO)
these will need to be changed.
Should now be able to go on to fix outstanding requests in gnats for the
testsuites.
git-svn-id: http://svn.cactuscode.org/flesh/trunk@2712 17b73243-c579-4c4c-a9d2-2d5706c11dac
|