Attention Wasn't All We Needed