Markov Decision Processes With Embedded Agents