Language Models in Plato's Cave