If anyone is currently trying to get Windows 10 HDR to not look very funky, the very latest AMD drivers seem to correct the issues.
Mine went from utterly unusable outside of gaming in HDR mode to being perfectly usable with just a slight tweak to the brightness.
The drivers are 19.12.3.