Indeed, I don't think this is the computer to run such benchmarks on, and I also don't think the issue is the driver performance itself. To me it rather looks like some race condition between Xorg and x11vnc. Maybe it's worth opening a ticket on the libvnc github?