The only way to be sure would be to try other browsers. If it isn't just a browser issue then I'm concerned about what is causing random slowdowns.
That sounds like your browser has the old server's pages cached and the new server is telling it "No, that is really outdated, accept my copy." and chrome is not wanting to update its cache.
Yea, the new server is definitely performing really well. It is odd that Sweden would be affected negatively, given I believe the server is physically closer, and Cloudflare should mitigate the whole distance problem.