Ad-Hoc Features and Where to Find Them, Part 1: Origin Story