I did some more testing, but still have some banding in my encodes.
x264 bitrate ~6000 kb/s
Code:
--preset veryslow --crf 18 --psy-rd 0.7 --aq-mode 3
x265 bitrate ~5750 kb/s
Code:
--preset veryslow --crf 15 --psy-rd 0.5 --aq-mode 3
result:
http://i.imgur.com/AyO8lHu.png
I also tried ssim-rd, 5777kb/s
Code:
--preset veryslow --crf 15.5 --rd 6 --ssim-rd --aq-mode 3
http://i.imgur.com/D1bJDGb.png
with more contrast for whose with bad monitors
http://i.imgur.com/dH4c99b.png
@LigH From that I read in all the threads and forums -> use -1,-2 or -3 deblocking and higher psy values, so that the image will remain sharp similar to x264 encodes. (also for animes)