We have some candidates for the constructive definition of string theory based on ten dimensional super Yang-Mills theory reduced to various dimensions. Although there are some evidences that these models describe gravity, the way how the diffeomorphism invariance is realized is not clear. In this talk, we introduce some attempts of constructing new types of matrix models in which the symmetry of the gravity can be seen manifestry. ©2002 American Institute of Physics.