Efficient Reinforcement Learning In Various Environments: From The Idealized To The Realistic