Markovian Agent Models: A Dynamic Population of Interdependent Markovian Agents