How to Optimize Remote SSH development

I have been trialing using Rider along with the remote Gateway over ssh as my primary development environment for a mid-size .NET and Angular application. I provisioned my remote server as per the recommended specs, and I am a single user on the server. My frame of reference for performance is Visual Studio Code remote development, and I am also a local development Pycharm user.

I would like some help optimizing my development experience. Basically it feels very slow. Specific examples are:

1. Every Cmd+B (mac user) triggers  a Thread Dump Message
2. Opening new files is nowhere near “instant”
3. Initializing my C# Debugger takes several clicks of the debug button, regularly with no feedback that any process has started
4. The bottom breadcrumb trail in the New UI does not allow me to double-click to open files

I have disabled any analysis tool I can find, as well as Roslyn.

What am I missing?

On the bright side, the system is at least relatively stable, especially when compared to my VS Code Remote Development experience. My connection does not drop and persists over network changes; once the debugger is up and running it is performant and rebuilds are fast.

Am i really just stuck between choosing either a slow but stable Rider experience, or a Fast but janky VS Code experience?