YouTube is very slow with VPN connection

The app is telling me that the server I’m connecting to has 47ms of latency, but when I use VPN YouTube can barely manage 144p quality.

I was only getting ~1-200kbps for some reason and had to hop servers a few times to get my usual bandwidth.