Exploring Probability Measures With Markov Processes