How to (and Not to) Manipulate Transformers: A Logic-First Guide