Doing Less and Going Deeper