The transversely bianisotropic uniaxial medium, a generalization of the well-studied chiral material, can be fabricated by mixing metal helices in an isotropic host medium in such a way as to have the axes of all helices randomly oriented but perpendicular to a fixed direction. In the present consideration, based on the concept of characteristic waves and the method of angular spectral expansion, field representations in this class of medium are developed. The analysis reveals that the solutions of source-free Maxwell's equations for transversely bianisotropic uniaxial medium can be expressed in sum-integral forms of circular cylindrical vector wave functions. The addition theorem of vector wave functions for transversely bianisotropic uniaxial medium can be straightforwardly derived from that of vector wave functions for isotropic medium. Applications of the proposed theory to electromagnetic scattering are presented.