I'm accessing SEPM directly, but remotely connecting to the server (that shouldn't make any difference right?)
Do you mean physical RAM or virtaul/file paging RAM?
scm-server-0.log has a couple of warnings:
2017-06-09 11:58:56.777 THREAD 46 SEVERE: Your hard disk space is less than <10,240>MB and impacts the performance of Symantec Endpoint Protection Manager. You should delete some files to free up space. Symantec recommends that you have a minimum of 10GB of free disk space.
2017-06-09 11:19:28.906 THREAD 50 WARNING: Log table switched to: AGENT_TRAFFIC_LOG_1, old table estimated row count: 50019, to add row count in new table: 100, last switch time: 2017-06-08 13:57:55
Do you think either of these could be the cause? I will be migrating to a new server later this year, but will have to stick with this one for a few months at least.