How Simple Is "As Simple as Possible"?