In this paper, we establish the Lyapunov function characterization which is a sufficient and necessary condition for mild solutions of semilinear stochastic evolution equations to be exponentially stable in mean square. We also study the Lyapunov function characterization of ultimate exponential boundedness, a concept which is closely related to the existence of invariant measures of non-stationary stochastic evolution equations