What Happens When There's No Job to Learn On?