Free object manipulation (translatetransform of mouse pos in 3D space)

Hi,

I am looking at transforming a sphere (My own implementation of a Manipulator UIElement) freely in space, thus without visible manipulators and known direction. I started looking at how to translate the mouse movement into a direction, thus be able to use the existing manipulator implementations. But what is the best way to go forward here?