I’d assume that it should be possible to use the projection matrix “backwards”, and calculate a line in 3D space from the 2D mouse coordinate on the screen. Intersecting this line with the objects it should be possible to find the object(s) which was pointed at.
Is this the way to do it? And if yes, how does one do the math? Matrix operations are nontrivial for me, so I will ned a bit of help with that. Thanks