I have started to use green screen and tracking points (from Match Move) for the background. I have no problems with tracking the two points.
It works fine as long as I tilt or pan with the camera but when I make a zoom in or out it is not conform scaling the background.