Most of the 500 known pulsars are solitary. A recently discovered population of binary pulsars now amounts to about 3% of the total; most of these have very short periods, and many of them are found in Globular Clusters. There is a clear evolutionary link between the X-ray binaries and pulsars. Mass transfer within the binary provides both the mechanism for the X-ray emission and the key to the various modes of evolution which lead to the binary pulsars. Disruption of a binary system may occur either through a supernova explosion in the pulsar's companion, or by evaporation of a low-mass companion by the radiation from the pulsar itself. This paper reviews the populations and characteristics of the binary and millisecond pulsars, and traces the various routes of evolution from the X-ray binaries.