Reference handler thread lag issues

So I’m working on a game with an open world esq environment and it currently is a bit of a memory whore which I’m working on however after running a memory check on the code I find that the memory is pretty well contained other than the graphics methods and yet I still get lag spikes, after investigating I found that the reference handler thread would spike up every now and again and seems to be the cause of the lag.

What causes this thread to actually spike up , I understand it’s to do with the garbage collector so would reducing my use of throwaway objects for arguments (eg some_function(new Vertex(x,y))) help with this problem?