Characterizing Discrete Representations For Reinforcement Learning