diff options
| author | Christophe Gisquet <christophe.gisquet@gmail.com> | 2015-10-12 19:37:45 +0200 |
|---|---|---|
| committer | Michael Niedermayer <michael@niedermayer.cc> | 2015-10-13 02:10:51 +0200 |
| commit | 2fd14dd8eb66dc5dd14254d0b758fb80d44b3140 (patch) | |
| tree | 34a086df2390e67180c11276193f258ae4b540e3 /tests/ref/fate | |
| parent | e9a68b0316ab127098ac4c24a6762ce68980bd23 (diff) | |
avcodec/simple_idct10: improve precision
omse goes from 0.03060703 (which fails for dct-test) to 0.01663750.
This also actually improve the error of decoding the sample generated
by fate-vsynth3-dnxhd1080i-10bit using simple_idct10 to FAANI, which
goes (when resampled to yuv422p) from:
stddev: 0.06 PSNR: 72.28 MAXDIFF: 1
to identical.
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
Diffstat (limited to 'tests/ref/fate')
| -rw-r--r-- | tests/ref/fate/dnxhr-444 | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/tests/ref/fate/dnxhr-444 b/tests/ref/fate/dnxhr-444 index 743067d95a..f9e73c313e 100644 --- a/tests/ref/fate/dnxhr-444 +++ b/tests/ref/fate/dnxhr-444 @@ -1,2 +1,2 @@ #tb 0: 1/24 -0, 0, 0, 1, 9665280, 0x238a023e +0, 0, 0, 1, 9665280, 0x19ef4057 |