Finding Where to Compromise with LLM's