summaryrefslogtreecommitdiff
path: root/tests/fate-run.sh
Commit message (Collapse)AuthorAge
* build: move tests/seek_test.c to libavformat and reuse generic build rulesDiego Biurrun2011-07-13
|
* fate: add 'null' comparison methodMans Rullgard2011-07-04
| | | | | | | | | Setting CMP=null uses stdout from the test as the diff record in the report without further inspection. This can be useful when the exit status of the test itself determines success while the output is informative. Signed-off-by: Mans Rullgard <mans@mansr.com>
* fate: remove output redirections from old regtest scriptsMans Rullgard2011-06-21
| | | | | | | | All tests are run through the fate-run.sh script which already sets up redirections. Using the outputs set there simplifies things somewhat. Signed-off-by: Mans Rullgard <mans@mansr.com>
* FATE: allow forcing thread-type when doing threaded fate runs.Ronald S. Bultje2011-04-21
| | | | Signed-off-by: Ronald S. Bultje <rsbultje@gmail.com>
* fate: add support for multithread testingLuca Barbato2011-03-23
| | | | Add a THREADS variable to fate calls.
* fate: print commands being executed with V=1Måns Rullgård2010-09-23
| | | | Originally committed as revision 25161 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: set LC_ALL=C to avoid locale interferenceMåns Rullgård2010-08-23
| | | | Originally committed as revision 24889 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate-run: use 'run' function in 'ffmpeg' functionMåns Rullgård2010-08-19
| | | | Originally committed as revision 24837 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: add -v 0 to ffmpeg flagsMåns Rullgård2010-08-19
| | | | Originally committed as revision 24836 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate-run: add helper to run things on targetMåns Rullgård2010-08-04
| | | | Originally committed as revision 24694 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: fix non-standard use of bcMåns Rullgård2010-08-01
| | | | Originally committed as revision 24651 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: fix signal name translationMåns Rullgård2010-08-01
| | | | Originally committed as revision 24650 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: translate exit status to signal nameMåns Rullgård2010-07-31
| | | | Originally committed as revision 24623 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: create report filesMåns Rullgård2010-07-26
| | | | Originally committed as revision 24529 to svn://svn.ffmpeg.org/ffmpeg/trunk
* Unbreak parallel lavfi testingMåns Rullgård2010-07-24
| | | | Originally committed as revision 24485 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: delete useless artifacts after running each testMåns Rullgård2010-07-21
| | | | Originally committed as revision 24395 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: keep stderr from failing testsMåns Rullgård2010-07-21
| | | | Originally committed as revision 24394 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: run diff even if command failsMåns Rullgård2010-07-20
| | | | | | | The diff may provide useful information even if the command was unsuccessful. The test is still treated as failed in this case. Originally committed as revision 24353 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: allow running regtests through fate frontendMåns Rullgård2010-07-20
| | | | Originally committed as revision 24347 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: simplify test runner slightlyMåns Rullgård2010-07-18
| | | | | | | All tests use the provided helper functions so prepending $target_exec and using eval is no longer required. Originally committed as revision 24317 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: add some helper functions to simplify test rulesMåns Rullgård2010-07-18
| | | | Originally committed as revision 24314 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: apply TARGET_EXEC only to commands starting with absolute pathMåns Rullgård2010-07-18
| | | | Originally committed as revision 24313 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: use our variable names in test rules imported from Mike's dbMåns Rullgård2010-07-18
| | | | Originally committed as revision 24312 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate-run: rename some variables consistently with other filesMåns Rullgård2010-07-18
| | | | Originally committed as revision 24311 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: add stddev comparatorMåns Rullgård2010-07-17
| | | | | | | This allows CMP=stddev in test rules. The test passes if the reported stddev is <= the FUZZ value (default 1). Originally committed as revision 24289 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: whitespace cosmeticsMåns Rullgård2010-07-17
| | | | Originally committed as revision 24288 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: ensure file sizes match in oneoff testsMåns Rullgård2010-07-10
| | | | Originally committed as revision 24164 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: fail with a sensible error message if reference file is missingMåns Rullgård2010-07-09
| | | | Originally committed as revision 24152 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: delete output files from successful testsMåns Rullgård2010-07-09
| | | | Originally committed as revision 24150 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: exit with error immediately if test command failsMåns Rullgård2010-07-09
| | | | Originally committed as revision 24147 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: add oneoff comparison methodMåns Rullgård2010-07-09
| | | | | | | | This adds the 'oneoff' comparison method. It compares two s16le pcm files with a max difference <= the fuzz factor treated as success. Default fuzz is 1. On failure, the full tiny_psnr output is printed. Originally committed as revision 24134 to svn://svn.ffmpeg.org/ffmpeg/trunk
* fate: pass additional variables to test scriptMåns Rullgård2010-07-09
| | | | | | | | | | This passes the following additional variables to the test script: - CMP method to use comparing output with reference, default 'diff' - REF reference file, default 'tests/ref/fate/${test}' - FUZZ maximum fuzz factor in comparison, meaning depends on CMP Originally committed as revision 24133 to svn://svn.ffmpeg.org/ffmpeg/trunk
* Add FATE testsMåns Rullgård2010-03-15
This adds a "fate" make target which runs the full FATE test suite. Individual tests can be run with "make fate-$testname". The location of the FATE test samples must be specified with the --samples=PATH option to configure. The tests/fate-update.sh script regenerates the references files and test list from the online FATE database. These are checked in since generating them requires non-standard tools. Originally committed as revision 22552 to svn://svn.ffmpeg.org/ffmpeg/trunk