A technique has recently been developed at Roke Manor Research Ltd. for recovering three-dimensional (3D) information from conventional video data. This is based on matching features in a scene observed from different viewpoints, either as a result of intrinsic camera or object motion or through the use of multiple cameras. The technique has been examined as a means of supplying guidance information to a robot manipulator and an autonomous vehicle. Results indicate that the method is capable of recognising basic surface structure in a variety of indoor and outdoor situations. The essential elements of the technique are described and a real-time system implementation is outlined. A surveillance application is also discussed whereby the derived 3D representation can be exploited in a data compression device to communicate concise 3D information to a remote operator or observer.