Adaptive Planning in Changing Policies and Environments