arcball model rotation

i have created an arcball control for rotating objects, it works pretty well, but the problem is i can move around this object with my arcball camera, and thus looking at an different part of the sphere, and this also means that the sphere doesn’t have to be centered at the middle of the screen, and the rotation of the object is wrong, how can i implement this

Paul