Do our own fp16 conversion in ResampleEffect.
authorSteinar H. Gunderson <sgunderson@bigfoot.com>
Sun, 9 Mar 2014 17:22:18 +0000 (18:22 +0100)
committerSteinar H. Gunderson <sgunderson@bigfoot.com>
Sun, 9 Mar 2014 17:22:18 +0000 (18:22 +0100)
commit818a3ca926f2acb93157b386fb1dcb511e6b56c4
tree722d3e56efeb96c757dc39f44d89cca41dba162a
parent4f0f3a800365a9f928387ad108ac904af0a966e6
Do our own fp16 conversion in ResampleEffect.

This not only fixes issues with poor downconversion on ATI, but also
allows us to normalize while being aware of fp16 roundoff issues.
Seems to about cut the error in half in the HeavyResampleGetsSumRight
test, which as far as I can see would take us up to 10-bit accuracy.
resample_effect.cpp
resample_effect_test.cpp