We consider a Markov Chain in which the states are fuzzy subsets defined on some finite state space. Building on the relationship between set-valued Markov chains to the Dempster-Shafer combination rule, we construct a procedure for finding transition probabilities from one fuzzy state to another. This construction involves Dempster-Shafer type mass functions having fuzzy focal elements. It also involves a measure of the degree to which two fuzzy sets are equal. We also show how to find approximate transition probabilities from a fuzzy state to a crisp state in the original state space